Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 833025 Details for
Bug 1027743
[Remove-brick] : Committing a brick from CLI does not remove the remove brick icon from the volume activities table.
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
engine logs
engine.log (text/x-log), 7.38 MB, created by
Shruti Sampat
on 2013-12-05 06:35:30 UTC
(
hide
)
Description:
engine logs
Filename:
MIME Type:
Creator:
Shruti Sampat
Created:
2013-12-05 06:35:30 UTC
Size:
7.38 MB
patch
obsolete
>2013-12-04 03:49:06,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59dc1def >2013-12-04 03:49:07,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 59dc1def >2013-12-04 03:49:07,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d581a64 >2013-12-04 03:49:07,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55fb338f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2101ae70}, log id: 4d581a64 >2013-12-04 03:49:12,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 67bc25be >2013-12-04 03:49:13,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 67bc25be >2013-12-04 03:49:13,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 461dd66b >2013-12-04 03:49:13,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17f94a4c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e968ab67}, log id: 461dd66b >2013-12-04 03:49:18,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: f785fea >2013-12-04 03:49:18,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: f785fea >2013-12-04 03:49:18,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 599db8cb >2013-12-04 03:49:19,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a85836f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@692bc253}, log id: 599db8cb >2013-12-04 03:49:24,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 56607e8f >2013-12-04 03:49:24,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 56607e8f >2013-12-04 03:49:24,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2569ff50 >2013-12-04 03:49:24,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71a7819a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f02e21a}, log id: 2569ff50 >2013-12-04 03:49:30,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1f33c51a >2013-12-04 03:49:30,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f33c51a >2013-12-04 03:49:30,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 679002b1 >2013-12-04 03:49:30,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42c3aae7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b895af4}, log id: 679002b1 >2013-12-04 03:49:35,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7ee03f54 >2013-12-04 03:49:36,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ee03f54 >2013-12-04 03:49:36,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3706bfcd >2013-12-04 03:49:36,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49234d55, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36874412}, log id: 3706bfcd >2013-12-04 03:49:41,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10f44ca9 >2013-12-04 03:49:42,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 10f44ca9 >2013-12-04 03:49:42,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: c8d8172 >2013-12-04 03:49:42,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a26c6778, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d4a152c}, log id: c8d8172 >2013-12-04 03:49:47,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 689a031a >2013-12-04 03:49:47,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 689a031a >2013-12-04 03:49:47,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7751d7fd >2013-12-04 03:49:48,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@337b0c63, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0aa0030}, log id: 7751d7fd >2013-12-04 03:49:49,917 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-04 03:49:49,917 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 03:49:49,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 439e841a >2013-12-04 03:49:50,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 439e841a >2013-12-04 03:49:53,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 75cb4892 >2013-12-04 03:49:53,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 75cb4892 >2013-12-04 03:49:53,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5710335 >2013-12-04 03:49:54,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2ed209, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20600f76}, log id: 5710335 >2013-12-04 03:49:59,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c34d50c >2013-12-04 03:49:59,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c34d50c >2013-12-04 03:49:59,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 47c83330 >2013-12-04 03:49:59,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15be914f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5205202}, log id: 47c83330 >2013-12-04 03:50:04,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5a1c33ab >2013-12-04 03:50:05,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5a1c33ab >2013-12-04 03:50:05,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: e4ac4d >2013-12-04 03:50:05,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f1acfd2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15abb47a}, log id: e4ac4d >2013-12-04 03:50:10,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59cd7430 >2013-12-04 03:50:11,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 59cd7430 >2013-12-04 03:50:11,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2c8b2d36 >2013-12-04 03:50:11,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7e45d5f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d2f9f19}, log id: 2c8b2d36 >2013-12-04 03:50:16,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14099bf5 >2013-12-04 03:50:17,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 14099bf5 >2013-12-04 03:50:17,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d114bee >2013-12-04 03:50:17,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9639e5bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@feff4c15}, log id: 2d114bee >2013-12-04 03:50:22,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d213d4d >2013-12-04 03:50:22,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d213d4d >2013-12-04 03:50:22,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 224432f6 >2013-12-04 03:50:23,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c19c753, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9793f3be}, log id: 224432f6 >2013-12-04 03:50:28,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5d0295b8 >2013-12-04 03:50:28,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d0295b8 >2013-12-04 03:50:28,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 73bde11f >2013-12-04 03:50:28,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@554cfe16, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dbd5248}, log id: 73bde11f >2013-12-04 03:50:33,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 309edad1 >2013-12-04 03:50:34,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 309edad1 >2013-12-04 03:50:34,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1007e4b2 >2013-12-04 03:50:34,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af90f3e8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d93574fe}, log id: 1007e4b2 >2013-12-04 03:50:39,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 66f04bd4 >2013-12-04 03:50:40,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 66f04bd4 >2013-12-04 03:50:40,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 74117928 >2013-12-04 03:50:40,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@296f1147, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98b8432d}, log id: 74117928 >2013-12-04 03:50:45,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 61aad4b3 >2013-12-04 03:50:46,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61aad4b3 >2013-12-04 03:50:46,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5fb9f7ae >2013-12-04 03:50:46,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b881a9d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77c8d0b7}, log id: 5fb9f7ae >2013-12-04 03:50:50,231 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) No up server in cluster >2013-12-04 03:50:50,231 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 03:50:50,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 46bd01eb >2013-12-04 03:50:50,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterTasksListVDSCommand, return: [], log id: 46bd01eb >2013-12-04 03:50:51,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 8bc9cba >2013-12-04 03:50:51,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8bc9cba >2013-12-04 03:50:51,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1844988b >2013-12-04 03:50:52,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37b5bf6a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbef024c}, log id: 1844988b >2013-12-04 03:50:57,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 514c07b1 >2013-12-04 03:50:57,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 514c07b1 >2013-12-04 03:50:57,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c3f6990 >2013-12-04 03:50:57,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2bd4719, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cf216af}, log id: 1c3f6990 >2013-12-04 03:51:03,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a629425 >2013-12-04 03:51:03,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a629425 >2013-12-04 03:51:03,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 225b3495 >2013-12-04 03:51:03,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1be4a795, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b0b9ae6}, log id: 225b3495 >2013-12-04 03:51:08,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2a29a557 >2013-12-04 03:51:09,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a29a557 >2013-12-04 03:51:09,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39c6964e >2013-12-04 03:51:09,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@add4eccf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ab33bb7}, log id: 39c6964e >2013-12-04 03:51:14,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6ebb98f6 >2013-12-04 03:51:15,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6ebb98f6 >2013-12-04 03:51:15,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d4bb92 >2013-12-04 03:51:15,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14fb3c52, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c597bfbd}, log id: 1d4bb92 >2013-12-04 03:51:20,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 484637ec >2013-12-04 03:51:20,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 484637ec >2013-12-04 03:51:20,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48456edc >2013-12-04 03:51:21,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6fd78bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb7ecf76}, log id: 48456edc >2013-12-04 03:51:26,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58496ca7 >2013-12-04 03:51:26,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 58496ca7 >2013-12-04 03:51:26,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6a9c009e >2013-12-04 03:51:27,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6da00f52, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f68a4060}, log id: 6a9c009e >2013-12-04 03:51:32,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ac6e18f >2013-12-04 03:51:32,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ac6e18f >2013-12-04 03:51:32,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5810aff5 >2013-12-04 03:51:32,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56d366b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2214fb3}, log id: 5810aff5 >2013-12-04 03:51:37,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a3c0a80 >2013-12-04 03:51:38,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4a3c0a80 >2013-12-04 03:51:38,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f8dfe68 >2013-12-04 03:51:38,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1f88780, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87aa4080}, log id: 3f8dfe68 >2013-12-04 03:51:43,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 462797be >2013-12-04 03:51:44,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 462797be >2013-12-04 03:51:44,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 679d81e3 >2013-12-04 03:51:44,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e141d909, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@450de730}, log id: 679d81e3 >2013-12-04 03:51:49,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 466a3ae6 >2013-12-04 03:51:49,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 466a3ae6 >2013-12-04 03:51:49,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 48c168e3 >2013-12-04 03:51:50,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e819034d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@615291a}, log id: 48c168e3 >2013-12-04 03:51:50,532 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2013-12-04 03:51:50,533 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 03:51:50,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6adb826d >2013-12-04 03:51:50,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6adb826d >2013-12-04 03:51:55,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 257bb7f6 >2013-12-04 03:51:55,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 257bb7f6 >2013-12-04 03:51:55,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 48d9e1c9 >2013-12-04 03:51:56,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4907982, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@789b6ce2}, log id: 48d9e1c9 >2013-12-04 03:52:01,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7ee8c1ef >2013-12-04 03:52:01,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ee8c1ef >2013-12-04 03:52:01,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16ba6876 >2013-12-04 03:52:01,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62052ee2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3d11678}, log id: 16ba6876 >2013-12-04 03:52:06,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 722729cf >2013-12-04 03:52:07,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 722729cf >2013-12-04 03:52:07,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6508f442 >2013-12-04 03:52:07,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82af72b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b83249ce}, log id: 6508f442 >2013-12-04 03:52:12,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f8ff0db >2013-12-04 03:52:13,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f8ff0db >2013-12-04 03:52:13,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 60ea46ac >2013-12-04 03:52:13,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21b13f5d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcff2c1d}, log id: 60ea46ac >2013-12-04 03:52:18,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2fe7cbc4 >2013-12-04 03:52:19,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fe7cbc4 >2013-12-04 03:52:19,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4eba4bb3 >2013-12-04 03:52:19,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36a372ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19809f77}, log id: 4eba4bb3 >2013-12-04 03:52:24,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28c17135 >2013-12-04 03:52:24,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 28c17135 >2013-12-04 03:52:24,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 482f3e33 >2013-12-04 03:52:25,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d39001a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ac88a7b}, log id: 482f3e33 >2013-12-04 03:52:30,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 8a14ab4 >2013-12-04 03:52:30,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 8a14ab4 >2013-12-04 03:52:30,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 31c078cd >2013-12-04 03:52:30,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1683a140, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62e10a25}, log id: 31c078cd >2013-12-04 03:52:36,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d561cbd >2013-12-04 03:52:36,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d561cbd >2013-12-04 03:52:36,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b62e37b >2013-12-04 03:52:36,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c0b39e4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f33bc041}, log id: b62e37b >2013-12-04 03:52:41,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 724c4a43 >2013-12-04 03:52:42,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 724c4a43 >2013-12-04 03:52:42,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19d19d97 >2013-12-04 03:52:42,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@508ea112, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fdb19e1}, log id: 19d19d97 >2013-12-04 03:52:47,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 52900ec7 >2013-12-04 03:52:48,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 52900ec7 >2013-12-04 03:52:48,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d6927b2 >2013-12-04 03:52:48,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c5df4ce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@492b27b8}, log id: 7d6927b2 >2013-12-04 03:52:50,842 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-04 03:52:50,843 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 03:52:50,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 18f41939 >2013-12-04 03:52:51,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 18f41939 >2013-12-04 03:52:53,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 693c6db3 >2013-12-04 03:52:53,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 693c6db3 >2013-12-04 03:52:53,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 51e12059 >2013-12-04 03:52:54,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@465d6168, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ab0dcf}, log id: 51e12059 >2013-12-04 03:52:59,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1799a000 >2013-12-04 03:52:59,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1799a000 >2013-12-04 03:52:59,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3437582a >2013-12-04 03:52:59,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e72f830d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a178bdd}, log id: 3437582a >2013-12-04 03:53:05,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 43f4587c >2013-12-04 03:53:05,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43f4587c >2013-12-04 03:53:05,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1e4c3904 >2013-12-04 03:53:05,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40a2dc45, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31254e8}, log id: 1e4c3904 >2013-12-04 03:53:10,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6aaa83ce >2013-12-04 03:53:11,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6aaa83ce >2013-12-04 03:53:11,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2cf175ab >2013-12-04 03:53:11,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4dd65b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75ee6caf}, log id: 2cf175ab >2013-12-04 03:53:16,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4827739e >2013-12-04 03:53:17,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4827739e >2013-12-04 03:53:17,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 31e6aba9 >2013-12-04 03:53:17,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec695bd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5ddf66d}, log id: 31e6aba9 >2013-12-04 03:53:22,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1dfd88e7 >2013-12-04 03:53:22,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1dfd88e7 >2013-12-04 03:53:22,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 53e290d2 >2013-12-04 03:53:23,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@245ea4da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a406bcf}, log id: 53e290d2 >2013-12-04 03:53:28,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3c4c7604 >2013-12-04 03:53:28,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c4c7604 >2013-12-04 03:53:28,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7b08740 >2013-12-04 03:53:29,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@423a00fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4913dc61}, log id: 7b08740 >2013-12-04 03:53:34,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6fa6e426 >2013-12-04 03:53:34,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fa6e426 >2013-12-04 03:53:34,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2cc780f8 >2013-12-04 03:53:34,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37ac264, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b4048a1}, log id: 2cc780f8 >2013-12-04 03:53:39,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5634c486 >2013-12-04 03:53:40,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5634c486 >2013-12-04 03:53:40,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2f52e0e8 >2013-12-04 03:53:40,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@302d1015, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41002684}, log id: 2f52e0e8 >2013-12-04 03:53:45,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c1c429b >2013-12-04 03:53:46,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c1c429b >2013-12-04 03:53:46,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 22a85f76 >2013-12-04 03:53:46,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2225a38, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99cd8e3c}, log id: 22a85f76 >2013-12-04 03:53:47,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b100310 >2013-12-04 03:53:47,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@12bc59be, log id: 1b100310 >2013-12-04 03:53:47,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ba7d28e >2013-12-04 03:53:47,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@33690f96, log id: ba7d28e >2013-12-04 03:53:51,150 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-04 03:53:51,150 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 03:53:51,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ba966f1 >2013-12-04 03:53:51,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6ba966f1 >2013-12-04 03:53:51,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b307000 >2013-12-04 03:53:52,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b307000 >2013-12-04 03:53:52,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4746956e >2013-12-04 03:53:52,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81c36f7e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f05d2cc8}, log id: 4746956e >2013-12-04 03:53:57,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c7647d5 >2013-12-04 03:53:57,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: c7647d5 >2013-12-04 03:53:57,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47dcaa41 >2013-12-04 03:53:58,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ebf04ad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e58a045}, log id: 47dcaa41 >2013-12-04 03:54:03,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6373c9 >2013-12-04 03:54:03,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6373c9 >2013-12-04 03:54:03,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e2af4bd >2013-12-04 03:54:04,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bea2aa7b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf13ca0c}, log id: 7e2af4bd >2013-12-04 03:54:09,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11c0fbf7 >2013-12-04 03:54:09,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 11c0fbf7 >2013-12-04 03:54:09,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f00fcd5 >2013-12-04 03:54:09,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2dee1730, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40f6e903}, log id: 7f00fcd5 >2013-12-04 03:54:14,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4b3ee384 >2013-12-04 03:54:15,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b3ee384 >2013-12-04 03:54:15,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 518aade0 >2013-12-04 03:54:15,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b88277e6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5456af40}, log id: 518aade0 >2013-12-04 03:54:20,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b1d1ef0 >2013-12-04 03:54:21,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: b1d1ef0 >2013-12-04 03:54:21,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12afede4 >2013-12-04 03:54:21,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@378aa3d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d51b9c}, log id: 12afede4 >2013-12-04 03:54:26,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3862b818 >2013-12-04 03:54:27,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3862b818 >2013-12-04 03:54:27,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f73bc7b >2013-12-04 03:54:27,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@888536f5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3daae74f}, log id: 7f73bc7b >2013-12-04 03:54:32,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 75784df6 >2013-12-04 03:54:32,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75784df6 >2013-12-04 03:54:32,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 77913fc0 >2013-12-04 03:54:33,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44c1cbdc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75a1886f}, log id: 77913fc0 >2013-12-04 03:54:38,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5cc7f833 >2013-12-04 03:54:38,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5cc7f833 >2013-12-04 03:54:38,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6db6d4b9 >2013-12-04 03:54:38,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5298260, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa3a2d24}, log id: 6db6d4b9 >2013-12-04 03:54:43,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1bdaf85a >2013-12-04 03:54:44,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1bdaf85a >2013-12-04 03:54:44,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 60f284ce >2013-12-04 03:54:44,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c00c48c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@455f261b}, log id: 60f284ce >2013-12-04 03:54:49,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 716ee9a2 >2013-12-04 03:54:50,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 716ee9a2 >2013-12-04 03:54:50,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a152918 >2013-12-04 03:54:50,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50f11347, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@563d2150}, log id: 6a152918 >2013-12-04 03:54:51,456 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-04 03:54:51,457 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 03:54:51,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a1210d2 >2013-12-04 03:54:51,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: a1210d2 >2013-12-04 03:54:55,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c7dd0bb >2013-12-04 03:54:56,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4c7dd0bb >2013-12-04 03:54:56,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5695b691 >2013-12-04 03:54:56,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdee0961, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6338f5e7}, log id: 5695b691 >2013-12-04 03:55:01,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 143c0222 >2013-12-04 03:55:01,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 143c0222 >2013-12-04 03:55:01,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 82a374 >2013-12-04 03:55:02,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68457e66, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87e228b3}, log id: 82a374 >2013-12-04 03:55:07,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b377b88 >2013-12-04 03:55:07,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b377b88 >2013-12-04 03:55:07,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ad39604 >2013-12-04 03:55:07,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fb05266, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@149ef9d4}, log id: 3ad39604 >2013-12-04 03:55:13,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 61f14a75 >2013-12-04 03:55:13,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 61f14a75 >2013-12-04 03:55:13,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6cd9bfd5 >2013-12-04 03:55:13,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7d4ea12, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24ba8f89}, log id: 6cd9bfd5 >2013-12-04 03:55:18,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5eb9fc4b >2013-12-04 03:55:19,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5eb9fc4b >2013-12-04 03:55:19,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 28e7592a >2013-12-04 03:55:19,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2c6356, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6442ec9}, log id: 28e7592a >2013-12-04 03:55:24,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 43ddbe4f >2013-12-04 03:55:25,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43ddbe4f >2013-12-04 03:55:25,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 527377a0 >2013-12-04 03:55:25,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@321632a1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41ee278e}, log id: 527377a0 >2013-12-04 03:55:30,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14157865 >2013-12-04 03:55:30,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 14157865 >2013-12-04 03:55:30,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 47beffe5 >2013-12-04 03:55:31,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@786ec3b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e657bba}, log id: 47beffe5 >2013-12-04 03:55:36,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7590c17c >2013-12-04 03:55:36,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7590c17c >2013-12-04 03:55:36,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 154f94b8 >2013-12-04 03:55:37,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23de045e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d07751d}, log id: 154f94b8 >2013-12-04 03:55:42,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39118cd9 >2013-12-04 03:55:42,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 39118cd9 >2013-12-04 03:55:42,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 251af29 >2013-12-04 03:55:42,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@619db3e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a291282}, log id: 251af29 >2013-12-04 03:55:47,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: e6c6fac >2013-12-04 03:55:48,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e6c6fac >2013-12-04 03:55:48,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 60fcdcbc >2013-12-04 03:55:48,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77a10b71, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40d670e0}, log id: 60fcdcbc >2013-12-04 03:55:51,767 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) No up server in cluster >2013-12-04 03:55:51,767 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 03:55:51,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 350ca90e >2013-12-04 03:55:52,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, return: [], log id: 350ca90e >2013-12-04 03:55:53,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2613e41 >2013-12-04 03:55:54,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2613e41 >2013-12-04 03:55:54,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 44b4cecf >2013-12-04 03:55:54,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b2c5c2a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f86402b3}, log id: 44b4cecf >2013-12-04 03:55:59,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1bcde974 >2013-12-04 03:56:00,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bcde974 >2013-12-04 03:56:00,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43fc11 >2013-12-04 03:56:00,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62a1c90f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e89b9af}, log id: 43fc11 >2013-12-04 03:56:05,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 440a32e8 >2013-12-04 03:56:05,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 440a32e8 >2013-12-04 03:56:05,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a2a717b >2013-12-04 03:56:06,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58cba7c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c143776}, log id: 3a2a717b >2013-12-04 03:56:11,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 28e540bc >2013-12-04 03:56:11,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28e540bc >2013-12-04 03:56:11,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 15b2a37d >2013-12-04 03:56:12,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@130220d0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b04853e2}, log id: 15b2a37d >2013-12-04 03:56:17,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6cde9d68 >2013-12-04 03:56:17,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cde9d68 >2013-12-04 03:56:17,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 505da4eb >2013-12-04 03:56:17,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@308c164a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@629268a7}, log id: 505da4eb >2013-12-04 03:56:22,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: cc52100 >2013-12-04 03:56:23,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: cc52100 >2013-12-04 03:56:23,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7aa109e7 >2013-12-04 03:56:23,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7afbcb0c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45129b27}, log id: 7aa109e7 >2013-12-04 03:56:28,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4ab8b757 >2013-12-04 03:56:29,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ab8b757 >2013-12-04 03:56:29,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5c0291c2 >2013-12-04 03:56:29,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e78bc2c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31c16b54}, log id: 5c0291c2 >2013-12-04 03:56:34,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6579b1dd >2013-12-04 03:56:34,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6579b1dd >2013-12-04 03:56:34,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3471f1e >2013-12-04 03:56:35,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83555e71, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f551ca00}, log id: 3471f1e >2013-12-04 03:56:40,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24cdf4 >2013-12-04 03:56:40,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 24cdf4 >2013-12-04 03:56:40,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 100ab64c >2013-12-04 03:56:41,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e56b476c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b586e4b6}, log id: 100ab64c >2013-12-04 03:56:46,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4ef25652 >2013-12-04 03:56:46,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ef25652 >2013-12-04 03:56:46,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 78e49c5e >2013-12-04 03:56:46,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5a35117, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f7751d4}, log id: 78e49c5e >2013-12-04 03:56:51,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 700162e3 >2013-12-04 03:56:52,066 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-04 03:56:52,067 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 03:56:52,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5874ca10 >2013-12-04 03:56:52,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5874ca10 >2013-12-04 03:56:52,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 700162e3 >2013-12-04 03:56:52,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6eba7e1d >2013-12-04 03:56:52,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19f89410, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7b97f41}, log id: 6eba7e1d >2013-12-04 03:56:57,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4b447032 >2013-12-04 03:56:58,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b447032 >2013-12-04 03:56:58,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ca297f1 >2013-12-04 03:56:58,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26c5aad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bac81e01}, log id: 4ca297f1 >2013-12-04 03:57:03,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4df01334 >2013-12-04 03:57:04,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4df01334 >2013-12-04 03:57:04,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6b62cdcf >2013-12-04 03:57:04,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@274222b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afcac40c}, log id: 6b62cdcf >2013-12-04 03:57:09,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 176fb411 >2013-12-04 03:57:09,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 176fb411 >2013-12-04 03:57:09,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63e560ee >2013-12-04 03:57:10,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd828eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e86a6081}, log id: 63e560ee >2013-12-04 03:57:15,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59500dbc >2013-12-04 03:57:15,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 59500dbc >2013-12-04 03:57:15,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 739149f1 >2013-12-04 03:57:15,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91b594f7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13510915}, log id: 739149f1 >2013-12-04 03:57:20,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: e540bd1 >2013-12-04 03:57:21,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e540bd1 >2013-12-04 03:57:21,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 41d5a7c3 >2013-12-04 03:57:21,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12261a23, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@715726e6}, log id: 41d5a7c3 >2013-12-04 03:57:26,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5dc4a6a >2013-12-04 03:57:27,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5dc4a6a >2013-12-04 03:57:27,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 395b34d4 >2013-12-04 03:57:27,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bd60b4e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc849a8}, log id: 395b34d4 >2013-12-04 03:57:32,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a8c0276 >2013-12-04 03:57:33,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a8c0276 >2013-12-04 03:57:33,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36bea5b1 >2013-12-04 03:57:33,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a77919b1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8a11193}, log id: 36bea5b1 >2013-12-04 03:57:38,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 670d6724 >2013-12-04 03:57:39,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 670d6724 >2013-12-04 03:57:39,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47b2c26 >2013-12-04 03:57:39,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ec47b84, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8504280a}, log id: 47b2c26 >2013-12-04 03:57:44,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3bd6ba9f >2013-12-04 03:57:44,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bd6ba9f >2013-12-04 03:57:44,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2560c733 >2013-12-04 03:57:45,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae72b3f4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4254b9d}, log id: 2560c733 >2013-12-04 03:57:50,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: a0d2c19 >2013-12-04 03:57:50,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: a0d2c19 >2013-12-04 03:57:50,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c5d1422 >2013-12-04 03:57:50,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8aabfdf8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b624b52b}, log id: 5c5d1422 >2013-12-04 03:57:52,358 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-04 03:57:52,358 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 03:57:52,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 30d708e2 >2013-12-04 03:57:52,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: 30d708e2 >2013-12-04 03:57:55,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56844c47 >2013-12-04 03:57:56,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 56844c47 >2013-12-04 03:57:56,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b7e3e72 >2013-12-04 03:57:56,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6862f6c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b527431}, log id: 5b7e3e72 >2013-12-04 03:58:01,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7c80cecb >2013-12-04 03:58:02,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c80cecb >2013-12-04 03:58:02,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 25318f >2013-12-04 03:58:02,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aea6ed1d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@926c9b8c}, log id: 25318f >2013-12-04 03:58:07,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1230a709 >2013-12-04 03:58:08,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1230a709 >2013-12-04 03:58:08,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 203d2650 >2013-12-04 03:58:08,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77e715e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cab538}, log id: 203d2650 >2013-12-04 03:58:13,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2a8f315a >2013-12-04 03:58:13,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a8f315a >2013-12-04 03:58:13,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6ab0503 >2013-12-04 03:58:14,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6c9f618, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65adb417}, log id: 6ab0503 >2013-12-04 03:58:19,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 38934414 >2013-12-04 03:58:19,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 38934414 >2013-12-04 03:58:19,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3aaec56 >2013-12-04 03:58:19,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efa08cc7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a62c24a9}, log id: 3aaec56 >2013-12-04 03:58:25,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 26f3f425 >2013-12-04 03:58:25,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 26f3f425 >2013-12-04 03:58:25,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6fcb3559 >2013-12-04 03:58:25,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@814c8ac9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b34a49d8}, log id: 6fcb3559 >2013-12-04 03:58:30,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2ac74fbb >2013-12-04 03:58:31,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2ac74fbb >2013-12-04 03:58:31,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2dd6c414 >2013-12-04 03:58:31,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d6957d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4511453}, log id: 2dd6c414 >2013-12-04 03:58:36,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5e636d0f >2013-12-04 03:58:37,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e636d0f >2013-12-04 03:58:37,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4f5a331c >2013-12-04 03:58:37,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be0c0eae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e64792cb}, log id: 4f5a331c >2013-12-04 03:58:42,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5188a28c >2013-12-04 03:58:43,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5188a28c >2013-12-04 03:58:43,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 23f7c6a2 >2013-12-04 03:58:43,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2e2a4a2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f0552ac}, log id: 23f7c6a2 >2013-12-04 03:58:47,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4202b66b >2013-12-04 03:58:48,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2ab313fc, log id: 4202b66b >2013-12-04 03:58:48,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 52e51b4a >2013-12-04 03:58:48,322 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-48) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 03:58:48,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3308caf0, log id: 52e51b4a >2013-12-04 03:58:48,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6436cbd >2013-12-04 03:58:48,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6436cbd >2013-12-04 03:58:48,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63c0fd30 >2013-12-04 03:58:49,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35b04c25, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f68dc81e}, log id: 63c0fd30 >2013-12-04 03:58:52,663 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-04 03:58:52,663 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 03:58:52,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 490c9d14 >2013-12-04 03:58:52,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 490c9d14 >2013-12-04 03:58:54,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 76d8f1b4 >2013-12-04 03:58:54,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 76d8f1b4 >2013-12-04 03:58:54,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1888ec58 >2013-12-04 03:58:55,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ca5f7a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa076d3f}, log id: 1888ec58 >2013-12-04 03:59:00,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 494499bc >2013-12-04 03:59:00,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 494499bc >2013-12-04 03:59:00,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 22287b4d >2013-12-04 03:59:00,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3828df0b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7acf0f9b}, log id: 22287b4d >2013-12-04 03:59:05,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6529d7f6 >2013-12-04 03:59:06,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6529d7f6 >2013-12-04 03:59:06,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b18c802 >2013-12-04 03:59:06,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83a5454e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7673bb8}, log id: 4b18c802 >2013-12-04 03:59:11,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 8cbda58 >2013-12-04 03:59:12,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8cbda58 >2013-12-04 03:59:12,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4b958a4e >2013-12-04 03:59:12,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f56c4910, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68b1898b}, log id: 4b958a4e >2013-12-04 03:59:17,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5af5ce3e >2013-12-04 03:59:18,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5af5ce3e >2013-12-04 03:59:18,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 310183fe >2013-12-04 03:59:18,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acb17556, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31e13274}, log id: 310183fe >2013-12-04 03:59:23,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b8f627c >2013-12-04 03:59:23,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: b8f627c >2013-12-04 03:59:23,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 100c14a >2013-12-04 03:59:24,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7376038e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5a16a75}, log id: 100c14a >2013-12-04 03:59:29,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14ee1c4d >2013-12-04 03:59:29,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 14ee1c4d >2013-12-04 03:59:29,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ded2c46 >2013-12-04 03:59:29,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19f5848f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc166a7a}, log id: 4ded2c46 >2013-12-04 03:59:34,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f34ce5f >2013-12-04 03:59:35,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f34ce5f >2013-12-04 03:59:35,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57ec6832 >2013-12-04 03:59:35,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95bed1c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4b24266}, log id: 57ec6832 >2013-12-04 03:59:40,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 76f4283b >2013-12-04 03:59:41,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 76f4283b >2013-12-04 03:59:41,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6932b29b >2013-12-04 03:59:41,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8621a8e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68b2143e}, log id: 6932b29b >2013-12-04 03:59:46,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71ad76e >2013-12-04 03:59:47,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 71ad76e >2013-12-04 03:59:47,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63d58fc2 >2013-12-04 03:59:47,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e0426ae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f8ab891}, log id: 63d58fc2 >2013-12-04 03:59:52,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6962a1d6 >2013-12-04 03:59:52,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6962a1d6 >2013-12-04 03:59:52,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6c8fe178 >2013-12-04 03:59:52,983 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) [451f957d] No up server in cluster >2013-12-04 03:59:52,993 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) [451f957d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 03:59:53,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e6e3dbb >2013-12-04 03:59:53,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb43d1d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c359241f}, log id: 6c8fe178 >2013-12-04 03:59:53,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5e6e3dbb >2013-12-04 03:59:58,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d140938 >2013-12-04 03:59:58,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: d140938 >2013-12-04 03:59:58,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1e61544d >2013-12-04 03:59:59,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c55db28, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4840788}, log id: 1e61544d >2013-12-04 04:00:04,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 686c65de >2013-12-04 04:00:04,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 686c65de >2013-12-04 04:00:04,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 51b103a3 >2013-12-04 04:00:04,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2497d821, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b05f43b1}, log id: 51b103a3 >2013-12-04 04:00:09,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 21b18203 >2013-12-04 04:00:10,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 21b18203 >2013-12-04 04:00:10,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b08e0c0 >2013-12-04 04:00:10,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73985f45, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5232ca65}, log id: 1b08e0c0 >2013-12-04 04:00:15,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5e7ca6b7 >2013-12-04 04:00:16,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e7ca6b7 >2013-12-04 04:00:16,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 615942db >2013-12-04 04:00:16,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26ef3abd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3347cb38}, log id: 615942db >2013-12-04 04:00:21,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f147927 >2013-12-04 04:00:22,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4f147927 >2013-12-04 04:00:22,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4091e988 >2013-12-04 04:00:22,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb684613, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86f30687}, log id: 4091e988 >2013-12-04 04:00:27,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5bf59ea7 >2013-12-04 04:00:27,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5bf59ea7 >2013-12-04 04:00:27,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b74618f >2013-12-04 04:00:28,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb43f05, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cf381a7}, log id: 6b74618f >2013-12-04 04:00:33,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7058f61 >2013-12-04 04:00:33,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7058f61 >2013-12-04 04:00:33,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c903e35 >2013-12-04 04:00:33,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86f8a33d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0351bbf}, log id: 3c903e35 >2013-12-04 04:00:38,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 44c846be >2013-12-04 04:00:39,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 44c846be >2013-12-04 04:00:39,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40a33b2e >2013-12-04 04:00:39,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3d0bf1f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f4b1a16}, log id: 40a33b2e >2013-12-04 04:00:44,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 431e140b >2013-12-04 04:00:45,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 431e140b >2013-12-04 04:00:45,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 382dfdc0 >2013-12-04 04:00:45,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59d6304b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ddc823f}, log id: 382dfdc0 >2013-12-04 04:00:50,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4d122be2 >2013-12-04 04:00:51,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d122be2 >2013-12-04 04:00:51,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7af127c1 >2013-12-04 04:00:51,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@190ca45c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88c567cc}, log id: 7af127c1 >2013-12-04 04:00:53,305 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2013-12-04 04:00:53,305 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:00:53,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1c2ac87d >2013-12-04 04:00:53,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1c2ac87d >2013-12-04 04:00:56,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5712242e >2013-12-04 04:00:56,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5712242e >2013-12-04 04:00:56,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 459ae95c >2013-12-04 04:00:57,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d1ad5d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3944a384}, log id: 459ae95c >2013-12-04 04:01:02,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 49ce2798 >2013-12-04 04:01:02,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 49ce2798 >2013-12-04 04:01:02,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 139f3386 >2013-12-04 04:01:03,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0b24cdf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81c11aee}, log id: 139f3386 >2013-12-04 04:01:08,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 74c7e77a >2013-12-04 04:01:08,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 74c7e77a >2013-12-04 04:01:08,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 17709417 >2013-12-04 04:01:08,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddac2b3d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6f0cecc}, log id: 17709417 >2013-12-04 04:01:13,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2db326bb >2013-12-04 04:01:14,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2db326bb >2013-12-04 04:01:14,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ddbfe9d >2013-12-04 04:01:14,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5323028, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c38f9e6d}, log id: 4ddbfe9d >2013-12-04 04:01:19,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6dfb17ba >2013-12-04 04:01:20,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6dfb17ba >2013-12-04 04:01:20,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 55e8e91f >2013-12-04 04:01:20,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@167ee266, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5af9e956}, log id: 55e8e91f >2013-12-04 04:01:25,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2c3091f0 >2013-12-04 04:01:25,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c3091f0 >2013-12-04 04:01:25,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6abad7de >2013-12-04 04:01:26,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f86012f1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4824b4cb}, log id: 6abad7de >2013-12-04 04:01:31,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41e3ebe0 >2013-12-04 04:01:31,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 41e3ebe0 >2013-12-04 04:01:31,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 49c9072 >2013-12-04 04:01:32,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fab3af6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84deba90}, log id: 49c9072 >2013-12-04 04:01:37,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: fbabe60 >2013-12-04 04:01:37,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: fbabe60 >2013-12-04 04:01:37,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6fb90688 >2013-12-04 04:01:37,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24ce5699, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31cd8789}, log id: 6fb90688 >2013-12-04 04:01:42,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54972287 >2013-12-04 04:01:43,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 54972287 >2013-12-04 04:01:43,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: e48f64f >2013-12-04 04:01:43,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fc7b7f6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f58debd2}, log id: e48f64f >2013-12-04 04:01:48,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32d00f59 >2013-12-04 04:01:49,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 32d00f59 >2013-12-04 04:01:49,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: efd2bdd >2013-12-04 04:01:49,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23737fc5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97c9b145}, log id: efd2bdd >2013-12-04 04:01:53,625 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-04 04:01:53,626 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:01:53,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 37a626bc >2013-12-04 04:01:53,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 37a626bc >2013-12-04 04:01:54,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 52619d8a >2013-12-04 04:01:55,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52619d8a >2013-12-04 04:01:55,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 18100504 >2013-12-04 04:01:55,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea6caefb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79a39ffc}, log id: 18100504 >2013-12-04 04:02:00,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29fb10e4 >2013-12-04 04:02:00,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 29fb10e4 >2013-12-04 04:02:00,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b1e2b7b >2013-12-04 04:02:01,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a22df71, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a89995f}, log id: 4b1e2b7b >2013-12-04 04:02:06,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67b56581 >2013-12-04 04:02:06,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 67b56581 >2013-12-04 04:02:06,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1df3b652 >2013-12-04 04:02:07,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fd93941, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b57a6d7}, log id: 1df3b652 >2013-12-04 04:02:12,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 73784d86 >2013-12-04 04:02:12,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73784d86 >2013-12-04 04:02:12,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 36012e12 >2013-12-04 04:02:12,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87196901, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5f32bdf}, log id: 36012e12 >2013-12-04 04:02:17,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5dd40b18 >2013-12-04 04:02:18,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5dd40b18 >2013-12-04 04:02:18,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38b1d97b >2013-12-04 04:02:18,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4be2615, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1de110bc}, log id: 38b1d97b >2013-12-04 04:02:23,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35c2961a >2013-12-04 04:02:24,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 35c2961a >2013-12-04 04:02:24,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 758c06ad >2013-12-04 04:02:24,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba7974d4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb29362}, log id: 758c06ad >2013-12-04 04:02:29,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 67b66203 >2013-12-04 04:02:30,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 67b66203 >2013-12-04 04:02:30,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 48ea2414 >2013-12-04 04:02:30,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dccc584c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f4ee383}, log id: 48ea2414 >2013-12-04 04:02:35,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54031dc1 >2013-12-04 04:02:35,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 54031dc1 >2013-12-04 04:02:35,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27133798 >2013-12-04 04:02:36,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f22e91bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd13bf3a}, log id: 27133798 >2013-12-04 04:02:41,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4c9f8a41 >2013-12-04 04:02:41,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c9f8a41 >2013-12-04 04:02:41,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 407b3abf >2013-12-04 04:02:41,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20e6431e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0c0e566}, log id: 407b3abf >2013-12-04 04:02:46,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 582a580a >2013-12-04 04:02:47,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 582a580a >2013-12-04 04:02:47,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2fa4356f >2013-12-04 04:02:47,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3084029c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62373ac5}, log id: 2fa4356f >2013-12-04 04:02:52,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2bf997cb >2013-12-04 04:02:53,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bf997cb >2013-12-04 04:02:53,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 72ae07e2 >2013-12-04 04:02:53,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a728661, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb4d3ecb}, log id: 72ae07e2 >2013-12-04 04:02:53,930 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-04 04:02:53,931 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:02:53,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 47f847ac >2013-12-04 04:02:54,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 47f847ac >2013-12-04 04:02:58,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: a333647 >2013-12-04 04:02:59,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: a333647 >2013-12-04 04:02:59,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 425d398d >2013-12-04 04:02:59,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff213c05, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6709b4b}, log id: 425d398d >2013-12-04 04:03:04,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4014331b >2013-12-04 04:03:04,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4014331b >2013-12-04 04:03:04,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 547b831f >2013-12-04 04:03:05,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abf02931, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3cb3b78}, log id: 547b831f >2013-12-04 04:03:10,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5385c1be >2013-12-04 04:03:10,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5385c1be >2013-12-04 04:03:10,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b66106a >2013-12-04 04:03:11,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@606e0561, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7576fe84}, log id: 2b66106a >2013-12-04 04:03:16,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6851240a >2013-12-04 04:03:16,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6851240a >2013-12-04 04:03:16,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 31639a6d >2013-12-04 04:03:16,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dedd20f1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f82a876f}, log id: 31639a6d >2013-12-04 04:03:21,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5912a0d5 >2013-12-04 04:03:22,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5912a0d5 >2013-12-04 04:03:22,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5c4bd86e >2013-12-04 04:03:22,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9173154, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a223c476}, log id: 5c4bd86e >2013-12-04 04:03:27,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2cf1ae06 >2013-12-04 04:03:28,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2cf1ae06 >2013-12-04 04:03:28,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 81a9647 >2013-12-04 04:03:28,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@286fa45, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62961a91}, log id: 81a9647 >2013-12-04 04:03:33,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c4e0f0d >2013-12-04 04:03:34,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3c4e0f0d >2013-12-04 04:03:34,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 699e7d8a >2013-12-04 04:03:34,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1c833f1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edeb0a36}, log id: 699e7d8a >2013-12-04 04:03:39,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e1a6df1 >2013-12-04 04:03:39,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e1a6df1 >2013-12-04 04:03:39,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d6ad089 >2013-12-04 04:03:40,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3244c2a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86ab05da}, log id: 3d6ad089 >2013-12-04 04:03:45,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 11804855 >2013-12-04 04:03:45,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 11804855 >2013-12-04 04:03:45,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ab79616 >2013-12-04 04:03:45,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3519e100, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9a14789}, log id: 2ab79616 >2013-12-04 04:03:48,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 13c446a9 >2013-12-04 04:03:48,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@12279997, log id: 13c446a9 >2013-12-04 04:03:48,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 65d491d0 >2013-12-04 04:03:49,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@33748e2, log id: 65d491d0 >2013-12-04 04:03:51,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6bd851bc >2013-12-04 04:03:51,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bd851bc >2013-12-04 04:03:51,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d3f6069 >2013-12-04 04:03:51,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d800da11, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5d50319}, log id: d3f6069 >2013-12-04 04:03:54,230 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-04 04:03:54,230 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:03:54,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 513b1c91 >2013-12-04 04:03:54,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 513b1c91 >2013-12-04 04:03:56,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6fc1411d >2013-12-04 04:03:57,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6fc1411d >2013-12-04 04:03:57,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47ae6e86 >2013-12-04 04:03:57,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0ccdd5d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fae9b6a}, log id: 47ae6e86 >2013-12-04 04:04:02,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 25ade99b >2013-12-04 04:04:03,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 25ade99b >2013-12-04 04:04:03,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20b986ad >2013-12-04 04:04:03,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@274b18b4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0a315d9}, log id: 20b986ad >2013-12-04 04:04:08,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2b4188e9 >2013-12-04 04:04:09,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b4188e9 >2013-12-04 04:04:09,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7cad1f95 >2013-12-04 04:04:09,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be368bdd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4e7ae78}, log id: 7cad1f95 >2013-12-04 04:04:14,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7af9dc21 >2013-12-04 04:04:14,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7af9dc21 >2013-12-04 04:04:14,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 76ada17c >2013-12-04 04:04:15,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@151e7840, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a82ce75e}, log id: 76ada17c >2013-12-04 04:04:20,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 329b7179 >2013-12-04 04:04:20,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 329b7179 >2013-12-04 04:04:20,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4cda2c89 >2013-12-04 04:04:20,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@154ddb87, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9a8a11c}, log id: 4cda2c89 >2013-12-04 04:04:25,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3993888e >2013-12-04 04:04:26,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3993888e >2013-12-04 04:04:26,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 12fd5086 >2013-12-04 04:04:26,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6582609c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e5bd2d7}, log id: 12fd5086 >2013-12-04 04:04:31,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 150666c6 >2013-12-04 04:04:32,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 150666c6 >2013-12-04 04:04:32,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4001b704 >2013-12-04 04:04:32,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf06ce02, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1db88d29}, log id: 4001b704 >2013-12-04 04:04:37,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5af260ca >2013-12-04 04:04:38,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5af260ca >2013-12-04 04:04:38,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 296da04c >2013-12-04 04:04:38,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bd33e86, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37b29dc}, log id: 296da04c >2013-12-04 04:04:43,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3a16cc06 >2013-12-04 04:04:43,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a16cc06 >2013-12-04 04:04:43,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6edea749 >2013-12-04 04:04:44,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8853ffe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@810c899b}, log id: 6edea749 >2013-12-04 04:04:49,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 498dca4f >2013-12-04 04:04:49,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 498dca4f >2013-12-04 04:04:49,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 71be5e3e >2013-12-04 04:04:49,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74dbcc65, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@160c1ce9}, log id: 71be5e3e >2013-12-04 04:04:54,533 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) No up server in cluster >2013-12-04 04:04:54,533 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:04:54,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 159228de >2013-12-04 04:04:54,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterTasksListVDSCommand, return: [], log id: 159228de >2013-12-04 04:04:55,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 43b6824 >2013-12-04 04:04:55,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43b6824 >2013-12-04 04:04:55,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 42322a1f >2013-12-04 04:04:55,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5770791c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5bc4845}, log id: 42322a1f >2013-12-04 04:05:00,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2f79d422 >2013-12-04 04:05:01,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f79d422 >2013-12-04 04:05:01,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f2033c9 >2013-12-04 04:05:01,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cbb3a12, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10f189ad}, log id: 7f2033c9 >2013-12-04 04:05:06,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 72e93ed5 >2013-12-04 04:05:07,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 72e93ed5 >2013-12-04 04:05:07,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4845dd25 >2013-12-04 04:05:07,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28a9805, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57d1084b}, log id: 4845dd25 >2013-12-04 04:05:12,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1eddb840 >2013-12-04 04:05:12,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1eddb840 >2013-12-04 04:05:12,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 72a909bc >2013-12-04 04:05:13,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c326cd1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d57f4bee}, log id: 72a909bc >2013-12-04 04:05:18,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c3a3273 >2013-12-04 04:05:18,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2c3a3273 >2013-12-04 04:05:18,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 56b2e227 >2013-12-04 04:05:19,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45568342, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@814aa922}, log id: 56b2e227 >2013-12-04 04:05:24,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 60c2a0c0 >2013-12-04 04:05:24,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 60c2a0c0 >2013-12-04 04:05:24,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 103b2257 >2013-12-04 04:05:24,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c32c8d1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69c73e8c}, log id: 103b2257 >2013-12-04 04:05:29,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 327ad696 >2013-12-04 04:05:30,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 327ad696 >2013-12-04 04:05:30,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4aa1d522 >2013-12-04 04:05:30,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d412f45, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaca082d}, log id: 4aa1d522 >2013-12-04 04:05:35,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45503095 >2013-12-04 04:05:36,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 45503095 >2013-12-04 04:05:36,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43928ae8 >2013-12-04 04:05:36,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d30f22d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30c68f39}, log id: 43928ae8 >2013-12-04 04:05:41,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 61e5192e >2013-12-04 04:05:42,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61e5192e >2013-12-04 04:05:42,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 616984e7 >2013-12-04 04:05:42,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45fed7d2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18984ee3}, log id: 616984e7 >2013-12-04 04:05:47,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2985aa79 >2013-12-04 04:05:48,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2985aa79 >2013-12-04 04:05:48,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 447d59dd >2013-12-04 04:05:48,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab08ad5b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f3ec9b4}, log id: 447d59dd >2013-12-04 04:05:53,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 46690058 >2013-12-04 04:05:53,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46690058 >2013-12-04 04:05:53,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 11209b8 >2013-12-04 04:05:54,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6744d7e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf4ec95e}, log id: 11209b8 >2013-12-04 04:05:54,842 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) No up server in cluster >2013-12-04 04:05:54,842 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:05:54,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ba44f6f >2013-12-04 04:05:55,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3ba44f6f >2013-12-04 04:05:59,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 28afd3bf >2013-12-04 04:05:59,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 28afd3bf >2013-12-04 04:05:59,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3958209b >2013-12-04 04:05:59,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fffcdeaa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea171e2e}, log id: 3958209b >2013-12-04 04:06:04,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 497d3797 >2013-12-04 04:06:05,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 497d3797 >2013-12-04 04:06:05,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3122f70 >2013-12-04 04:06:05,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc5305b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2eb47507}, log id: 3122f70 >2013-12-04 04:06:10,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 13a9c3ad >2013-12-04 04:06:11,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 13a9c3ad >2013-12-04 04:06:11,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 64dfaa5f >2013-12-04 04:06:11,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27b3dd46, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90473b3b}, log id: 64dfaa5f >2013-12-04 04:06:16,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 690c4ecd >2013-12-04 04:06:17,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 690c4ecd >2013-12-04 04:06:17,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 673b9ab6 >2013-12-04 04:06:17,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eebbff39, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3db9ebcf}, log id: 673b9ab6 >2013-12-04 04:06:22,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34a88607 >2013-12-04 04:06:22,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 34a88607 >2013-12-04 04:06:22,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45fc068d >2013-12-04 04:06:23,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa4f5fc6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3a3b297}, log id: 45fc068d >2013-12-04 04:06:28,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 68c9effc >2013-12-04 04:06:28,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 68c9effc >2013-12-04 04:06:28,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f531b4d >2013-12-04 04:06:29,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@448bcf95, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67dec430}, log id: 3f531b4d >2013-12-04 04:06:34,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1ce72ca1 >2013-12-04 04:06:34,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ce72ca1 >2013-12-04 04:06:34,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f6ac23f >2013-12-04 04:06:34,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94020972, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6764930f}, log id: 5f6ac23f >2013-12-04 04:06:39,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 38806d1f >2013-12-04 04:06:40,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38806d1f >2013-12-04 04:06:40,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 331566c2 >2013-12-04 04:06:40,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cba47c94, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaab52c2}, log id: 331566c2 >2013-12-04 04:06:45,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ba0d26d >2013-12-04 04:06:46,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: ba0d26d >2013-12-04 04:06:46,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45e31134 >2013-12-04 04:06:46,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42bbec63, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5120d39a}, log id: 45e31134 >2013-12-04 04:06:51,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7135cf2e >2013-12-04 04:06:51,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7135cf2e >2013-12-04 04:06:51,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 60d14e97 >2013-12-04 04:06:52,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@688631d1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eba58ec}, log id: 60d14e97 >2013-12-04 04:06:55,160 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) No up server in cluster >2013-12-04 04:06:55,160 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:06:55,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 24e650a3 >2013-12-04 04:06:55,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterTasksListVDSCommand, return: [], log id: 24e650a3 >2013-12-04 04:06:57,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6d3f7464 >2013-12-04 04:06:57,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d3f7464 >2013-12-04 04:06:57,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10331704 >2013-12-04 04:06:58,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9cc6f4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1beed5ac}, log id: 10331704 >2013-12-04 04:07:03,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70f70ed8 >2013-12-04 04:07:03,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 70f70ed8 >2013-12-04 04:07:03,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45cd1602 >2013-12-04 04:07:03,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6d8d881, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@397c4111}, log id: 45cd1602 >2013-12-04 04:07:08,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1106637f >2013-12-04 04:07:09,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1106637f >2013-12-04 04:07:09,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 553f58a7 >2013-12-04 04:07:09,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fec1931b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb5511c4}, log id: 553f58a7 >2013-12-04 04:07:14,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c426060 >2013-12-04 04:07:15,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4c426060 >2013-12-04 04:07:15,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6e4508e0 >2013-12-04 04:07:15,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d1808cb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba4f229b}, log id: 6e4508e0 >2013-12-04 04:07:20,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12f9d7c5 >2013-12-04 04:07:21,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 12f9d7c5 >2013-12-04 04:07:21,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 84905f6 >2013-12-04 04:07:21,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee532db5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5787792b}, log id: 84905f6 >2013-12-04 04:07:26,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4be26083 >2013-12-04 04:07:26,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4be26083 >2013-12-04 04:07:26,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7719caaa >2013-12-04 04:07:27,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c8c8b22, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25540fa9}, log id: 7719caaa >2013-12-04 04:07:32,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3c233b69 >2013-12-04 04:07:32,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c233b69 >2013-12-04 04:07:32,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 77abf929 >2013-12-04 04:07:33,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8211ed4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97d15406}, log id: 77abf929 >2013-12-04 04:07:38,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4dbdc7f9 >2013-12-04 04:07:38,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4dbdc7f9 >2013-12-04 04:07:38,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9dc23e5 >2013-12-04 04:07:38,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42551388, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d27fc767}, log id: 9dc23e5 >2013-12-04 04:07:43,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: e90e7cb >2013-12-04 04:07:44,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: e90e7cb >2013-12-04 04:07:44,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7bdf1d2c >2013-12-04 04:07:44,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9021312, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b7a735d}, log id: 7bdf1d2c >2013-12-04 04:07:49,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71147448 >2013-12-04 04:07:50,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 71147448 >2013-12-04 04:07:50,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 297309b9 >2013-12-04 04:07:50,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9706e38b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cda787a7}, log id: 297309b9 >2013-12-04 04:07:55,467 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-04 04:07:55,468 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:07:55,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29ba5899 >2013-12-04 04:07:55,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4410bb5f >2013-12-04 04:07:55,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 29ba5899 >2013-12-04 04:07:56,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4410bb5f >2013-12-04 04:07:56,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 25d5413e >2013-12-04 04:07:56,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@308d99a1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15dfc23e}, log id: 25d5413e >2013-12-04 04:08:01,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ca8a80b >2013-12-04 04:08:01,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5ca8a80b >2013-12-04 04:08:01,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: fb9a699 >2013-12-04 04:08:02,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18b7a7d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3130324}, log id: fb9a699 >2013-12-04 04:08:07,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a61d2db >2013-12-04 04:08:07,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7a61d2db >2013-12-04 04:08:07,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6657b296 >2013-12-04 04:08:07,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48c2c820, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69eabcb4}, log id: 6657b296 >2013-12-04 04:08:12,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1385d8b5 >2013-12-04 04:08:13,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1385d8b5 >2013-12-04 04:08:13,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 51a3a91 >2013-12-04 04:08:13,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e84430f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@469028d2}, log id: 51a3a91 >2013-12-04 04:08:18,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 596e7074 >2013-12-04 04:08:19,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 596e7074 >2013-12-04 04:08:19,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 491b8528 >2013-12-04 04:08:19,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1bcf59e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@381a07f}, log id: 491b8528 >2013-12-04 04:08:24,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 11789de8 >2013-12-04 04:08:25,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 11789de8 >2013-12-04 04:08:25,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1af8a31d >2013-12-04 04:08:25,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fac6cfa6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8aa602f6}, log id: 1af8a31d >2013-12-04 04:08:30,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1225f4cb >2013-12-04 04:08:30,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1225f4cb >2013-12-04 04:08:30,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38ced79 >2013-12-04 04:08:31,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca4267c3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0c0778e}, log id: 38ced79 >2013-12-04 04:08:36,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 8ebba4a >2013-12-04 04:08:36,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 8ebba4a >2013-12-04 04:08:36,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 148ff19b >2013-12-04 04:08:36,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa53d6f5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7979ef36}, log id: 148ff19b >2013-12-04 04:08:42,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5249a40e >2013-12-04 04:08:42,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5249a40e >2013-12-04 04:08:42,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 10146c3f >2013-12-04 04:08:42,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5345a6c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b310fd7}, log id: 10146c3f >2013-12-04 04:08:47,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45e74094 >2013-12-04 04:08:48,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 45e74094 >2013-12-04 04:08:48,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ba79b00 >2013-12-04 04:08:48,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46caa2fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b493c389}, log id: 2ba79b00 >2013-12-04 04:08:49,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 431685f2 >2013-12-04 04:08:49,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@578abc27, log id: 431685f2 >2013-12-04 04:08:49,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5546d157 >2013-12-04 04:08:49,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1ffa9dc7, log id: 5546d157 >2013-12-04 04:08:53,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 23a429dc >2013-12-04 04:08:54,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 23a429dc >2013-12-04 04:08:54,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f37a116 >2013-12-04 04:08:54,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8580b79, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@182add26}, log id: 5f37a116 >2013-12-04 04:08:55,736 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-04 04:08:55,736 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:08:55,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2480d778 >2013-12-04 04:08:56,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2480d778 >2013-12-04 04:08:59,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c0b1570 >2013-12-04 04:08:59,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c0b1570 >2013-12-04 04:08:59,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 760f864e >2013-12-04 04:09:00,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23e4c84a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b67e1224}, log id: 760f864e >2013-12-04 04:09:05,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b4aca75 >2013-12-04 04:09:05,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b4aca75 >2013-12-04 04:09:05,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 65d68f5e >2013-12-04 04:09:06,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1dee5ec0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42b315ae}, log id: 65d68f5e >2013-12-04 04:09:11,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 364d7590 >2013-12-04 04:09:11,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 364d7590 >2013-12-04 04:09:11,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1f14949f >2013-12-04 04:09:11,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c29b985, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9293f14}, log id: 1f14949f >2013-12-04 04:09:16,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a43ad69 >2013-12-04 04:09:17,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a43ad69 >2013-12-04 04:09:17,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3798cf8 >2013-12-04 04:09:17,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce7df74e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9485a738}, log id: 3798cf8 >2013-12-04 04:09:22,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1a584d63 >2013-12-04 04:09:23,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a584d63 >2013-12-04 04:09:23,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 19906e15 >2013-12-04 04:09:23,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d136d047, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@211d474a}, log id: 19906e15 >2013-12-04 04:09:28,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 65c209f9 >2013-12-04 04:09:29,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 65c209f9 >2013-12-04 04:09:29,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 539ace13 >2013-12-04 04:09:29,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bdc70d2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d631dfd0}, log id: 539ace13 >2013-12-04 04:09:34,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 41ecaec1 >2013-12-04 04:09:34,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41ecaec1 >2013-12-04 04:09:34,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3f5372c7 >2013-12-04 04:09:35,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2571266, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e47ef82}, log id: 3f5372c7 >2013-12-04 04:09:40,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6d3d5533 >2013-12-04 04:09:40,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d3d5533 >2013-12-04 04:09:40,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7a9295f5 >2013-12-04 04:09:40,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c099ddc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@293f74f0}, log id: 7a9295f5 >2013-12-04 04:09:45,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22bb73e1 >2013-12-04 04:09:46,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 22bb73e1 >2013-12-04 04:09:46,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 77d9022 >2013-12-04 04:09:46,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@664c7cf5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0a7916e}, log id: 77d9022 >2013-12-04 04:09:51,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 298c5e13 >2013-12-04 04:09:52,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 298c5e13 >2013-12-04 04:09:52,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d36e9b8 >2013-12-04 04:09:52,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2246ba92, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7da8e6e1}, log id: 4d36e9b8 >2013-12-04 04:09:56,063 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2013-12-04 04:09:56,064 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:09:56,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12bf54f6 >2013-12-04 04:09:56,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 12bf54f6 >2013-12-04 04:09:57,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5944308d >2013-12-04 04:09:58,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5944308d >2013-12-04 04:09:58,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7e7e5cf1 >2013-12-04 04:09:58,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e40fc183, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f51b374f}, log id: 7e7e5cf1 >2013-12-04 04:10:03,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 28ed8839 >2013-12-04 04:10:03,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 28ed8839 >2013-12-04 04:10:03,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 506720c3 >2013-12-04 04:10:04,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5afa302c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bce7cc67}, log id: 506720c3 >2013-12-04 04:10:09,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7346217e >2013-12-04 04:10:09,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7346217e >2013-12-04 04:10:09,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 49d9c3e7 >2013-12-04 04:10:10,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaab9dbc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@caea8260}, log id: 49d9c3e7 >2013-12-04 04:10:15,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 59282d9f >2013-12-04 04:10:15,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59282d9f >2013-12-04 04:10:15,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2b39c966 >2013-12-04 04:10:15,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a754351, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be55d7eb}, log id: 2b39c966 >2013-12-04 04:10:20,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3e465e23 >2013-12-04 04:10:21,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e465e23 >2013-12-04 04:10:21,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5bcbf5f9 >2013-12-04 04:10:21,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58f293ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce220929}, log id: 5bcbf5f9 >2013-12-04 04:10:26,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4d9a2e98 >2013-12-04 04:10:27,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d9a2e98 >2013-12-04 04:10:27,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b60884a >2013-12-04 04:10:27,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83f9474, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2b28740}, log id: b60884a >2013-12-04 04:10:32,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2298dbeb >2013-12-04 04:10:33,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2298dbeb >2013-12-04 04:10:33,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: fe35ba4 >2013-12-04 04:10:33,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15967382, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@453c2bbf}, log id: fe35ba4 >2013-12-04 04:10:38,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2c48042b >2013-12-04 04:10:38,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c48042b >2013-12-04 04:10:38,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2f161be9 >2013-12-04 04:10:39,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dc54e59, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75dd589a}, log id: 2f161be9 >2013-12-04 04:10:44,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2362f5b4 >2013-12-04 04:10:44,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2362f5b4 >2013-12-04 04:10:44,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d79117b >2013-12-04 04:10:45,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60b4b947, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86c8f6dd}, log id: 3d79117b >2013-12-04 04:10:50,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 55147540 >2013-12-04 04:10:50,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 55147540 >2013-12-04 04:10:50,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 73c3abc1 >2013-12-04 04:10:50,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1c57681, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ab3db8c}, log id: 73c3abc1 >2013-12-04 04:10:55,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2a9124ca >2013-12-04 04:10:56,389 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-04 04:10:56,389 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:10:56,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e7f11fc >2013-12-04 04:10:56,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a9124ca >2013-12-04 04:10:56,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7af4932e >2013-12-04 04:10:56,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6e7f11fc >2013-12-04 04:10:56,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f15373, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88911f9d}, log id: 7af4932e >2013-12-04 04:11:01,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19a27be0 >2013-12-04 04:11:02,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 19a27be0 >2013-12-04 04:11:02,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a8a700c >2013-12-04 04:11:02,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e8698b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b7061e5}, log id: 1a8a700c >2013-12-04 04:11:07,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 44c77cb8 >2013-12-04 04:11:08,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 44c77cb8 >2013-12-04 04:11:08,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 31669a41 >2013-12-04 04:11:08,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b8d9c35, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7699400}, log id: 31669a41 >2013-12-04 04:11:13,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70832874 >2013-12-04 04:11:13,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 70832874 >2013-12-04 04:11:13,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a3798ec >2013-12-04 04:11:14,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5ff9220, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8beff275}, log id: 7a3798ec >2013-12-04 04:11:19,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6e027fa3 >2013-12-04 04:11:19,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e027fa3 >2013-12-04 04:11:19,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6287710a >2013-12-04 04:11:19,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46a3bfee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da279359}, log id: 6287710a >2013-12-04 04:11:25,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5908994a >2013-12-04 04:11:25,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5908994a >2013-12-04 04:11:25,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b9f5fb2 >2013-12-04 04:11:25,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@575c9770, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66b55277}, log id: 4b9f5fb2 >2013-12-04 04:11:30,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7531bcc3 >2013-12-04 04:11:31,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7531bcc3 >2013-12-04 04:11:31,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: a77928 >2013-12-04 04:11:31,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94e44dd9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bdede27}, log id: a77928 >2013-12-04 04:11:36,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48fd75bd >2013-12-04 04:11:37,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 48fd75bd >2013-12-04 04:11:37,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7574815e >2013-12-04 04:11:37,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13ad59f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5631ffc8}, log id: 7574815e >2013-12-04 04:11:42,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5c1bf6ec >2013-12-04 04:11:42,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c1bf6ec >2013-12-04 04:11:42,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 602f68f1 >2013-12-04 04:11:43,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbefa3b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6e6b92c}, log id: 602f68f1 >2013-12-04 04:11:48,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c6e938d >2013-12-04 04:11:48,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c6e938d >2013-12-04 04:11:48,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f2425eb >2013-12-04 04:11:49,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cfbceb8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7a99228}, log id: 5f2425eb >2013-12-04 04:11:54,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6b16929a >2013-12-04 04:11:54,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b16929a >2013-12-04 04:11:54,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6b1abbdd >2013-12-04 04:11:54,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f51821e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1947fe08}, log id: 6b1abbdd >2013-12-04 04:11:56,670 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-04 04:11:56,670 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:11:56,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 127a03c1 >2013-12-04 04:11:56,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 127a03c1 >2013-12-04 04:11:59,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 139282d6 >2013-12-04 04:12:00,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 139282d6 >2013-12-04 04:12:00,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e5e3464 >2013-12-04 04:12:00,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53d2db1b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66e12820}, log id: e5e3464 >2013-12-04 04:12:05,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6b64b400 >2013-12-04 04:12:06,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b64b400 >2013-12-04 04:12:06,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 53e4e8d8 >2013-12-04 04:12:06,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b02dae2e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a09a548}, log id: 53e4e8d8 >2013-12-04 04:12:11,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 36c191d >2013-12-04 04:12:12,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36c191d >2013-12-04 04:12:12,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 12fd7eb >2013-12-04 04:12:12,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1f3494a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cb26302}, log id: 12fd7eb >2013-12-04 04:12:17,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 742df607 >2013-12-04 04:12:17,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 742df607 >2013-12-04 04:12:17,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 615f08f1 >2013-12-04 04:12:18,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84270744, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebd19c3f}, log id: 615f08f1 >2013-12-04 04:12:23,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 52e4aecb >2013-12-04 04:12:23,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52e4aecb >2013-12-04 04:12:23,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 633849f4 >2013-12-04 04:12:23,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81cf190, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@570e9c91}, log id: 633849f4 >2013-12-04 04:12:28,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f41149b >2013-12-04 04:12:29,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f41149b >2013-12-04 04:12:29,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79509325 >2013-12-04 04:12:29,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d034e865, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@595bf25}, log id: 79509325 >2013-12-04 04:12:34,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 75ecca81 >2013-12-04 04:12:35,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75ecca81 >2013-12-04 04:12:35,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 691b040e >2013-12-04 04:12:35,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac92d95d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2bf27e6}, log id: 691b040e >2013-12-04 04:12:40,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2bb3a4fc >2013-12-04 04:12:41,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2bb3a4fc >2013-12-04 04:12:41,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36909867 >2013-12-04 04:12:41,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8b33f54, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2cf524d}, log id: 36909867 >2013-12-04 04:12:46,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 537b5463 >2013-12-04 04:12:46,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 537b5463 >2013-12-04 04:12:46,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 69dfab4 >2013-12-04 04:12:47,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35731e74, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf028389}, log id: 69dfab4 >2013-12-04 04:12:52,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6b7e1c1f >2013-12-04 04:12:52,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b7e1c1f >2013-12-04 04:12:52,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4bd430fa >2013-12-04 04:12:53,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e1a917, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5df1d0a8}, log id: 4bd430fa >2013-12-04 04:12:56,980 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-04 04:12:56,980 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:12:56,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a7cdebe >2013-12-04 04:12:57,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3a7cdebe >2013-12-04 04:12:58,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 69a01572 >2013-12-04 04:12:58,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69a01572 >2013-12-04 04:12:58,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1e463525 >2013-12-04 04:12:58,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d68df13b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@837db819}, log id: 1e463525 >2013-12-04 04:13:03,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7c21285b >2013-12-04 04:13:04,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c21285b >2013-12-04 04:13:04,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 25be1b70 >2013-12-04 04:13:04,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5397912, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7814abe7}, log id: 25be1b70 >2013-12-04 04:13:09,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 23fbd1a6 >2013-12-04 04:13:10,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23fbd1a6 >2013-12-04 04:13:10,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1e44d9b >2013-12-04 04:13:10,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f211b98, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1b6cfd9}, log id: 1e44d9b >2013-12-04 04:13:15,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3c116145 >2013-12-04 04:13:16,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c116145 >2013-12-04 04:13:16,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 67ff7347 >2013-12-04 04:13:16,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15ebbf4c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adf3555d}, log id: 67ff7347 >2013-12-04 04:13:21,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45920bbc >2013-12-04 04:13:21,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 45920bbc >2013-12-04 04:13:21,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6bf25122 >2013-12-04 04:13:22,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95dca489, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@774525a9}, log id: 6bf25122 >2013-12-04 04:13:27,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42d315c2 >2013-12-04 04:13:27,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 42d315c2 >2013-12-04 04:13:27,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: eae7357 >2013-12-04 04:13:27,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0998c4e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cacbc20}, log id: eae7357 >2013-12-04 04:13:32,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f8f4091 >2013-12-04 04:13:33,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7f8f4091 >2013-12-04 04:13:33,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 167d8cd0 >2013-12-04 04:13:33,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fe10215, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@826df2d5}, log id: 167d8cd0 >2013-12-04 04:13:38,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6deb30a8 >2013-12-04 04:13:39,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6deb30a8 >2013-12-04 04:13:39,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19c017cf >2013-12-04 04:13:39,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e4e62e4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5246f265}, log id: 19c017cf >2013-12-04 04:13:44,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34d429a0 >2013-12-04 04:13:45,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 34d429a0 >2013-12-04 04:13:45,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 172f2f3c >2013-12-04 04:13:45,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dfac3b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fc4c474}, log id: 172f2f3c >2013-12-04 04:13:49,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1263c624 >2013-12-04 04:13:50,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6863b12b, log id: 1263c624 >2013-12-04 04:13:50,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6904b397 >2013-12-04 04:13:50,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@254d819f, log id: 6904b397 >2013-12-04 04:13:50,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7c6d7c2f >2013-12-04 04:13:50,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c6d7c2f >2013-12-04 04:13:50,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18825ec8 >2013-12-04 04:13:51,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ff1b4c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5aaa7919}, log id: 18825ec8 >2013-12-04 04:13:56,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 42c2771f >2013-12-04 04:13:56,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 42c2771f >2013-12-04 04:13:56,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 37e4dc22 >2013-12-04 04:13:57,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0ab93bd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d2c0ae4}, log id: 37e4dc22 >2013-12-04 04:13:57,282 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-04 04:13:57,282 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:13:57,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4710c5ca >2013-12-04 04:13:57,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4710c5ca >2013-12-04 04:14:02,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 21a31e65 >2013-12-04 04:14:02,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 21a31e65 >2013-12-04 04:14:02,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 13765c45 >2013-12-04 04:14:02,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b98b593c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b288cbc}, log id: 13765c45 >2013-12-04 04:14:07,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 98ed2a0 >2013-12-04 04:14:08,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 98ed2a0 >2013-12-04 04:14:08,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3024bb5f >2013-12-04 04:14:08,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b1fdf60, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dd05c40}, log id: 3024bb5f >2013-12-04 04:14:13,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: d6ee630 >2013-12-04 04:14:14,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: d6ee630 >2013-12-04 04:14:14,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7abb622a >2013-12-04 04:14:14,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c013b02b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88e6400d}, log id: 7abb622a >2013-12-04 04:14:19,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f943931 >2013-12-04 04:14:19,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f943931 >2013-12-04 04:14:19,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 709ae1aa >2013-12-04 04:14:20,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48e744a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b56e0ff}, log id: 709ae1aa >2013-12-04 04:14:25,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5d0ad98 >2013-12-04 04:14:25,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d0ad98 >2013-12-04 04:14:25,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34330e7f >2013-12-04 04:14:26,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@557145ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adc1a24b}, log id: 34330e7f >2013-12-04 04:14:31,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 407f93e2 >2013-12-04 04:14:31,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 407f93e2 >2013-12-04 04:14:31,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 524848 >2013-12-04 04:14:31,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ea19206, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f692d0e0}, log id: 524848 >2013-12-04 04:14:36,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 34755949 >2013-12-04 04:14:37,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34755949 >2013-12-04 04:14:37,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 78380b5c >2013-12-04 04:14:37,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52faec55, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8e04d3e}, log id: 78380b5c >2013-12-04 04:14:42,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7f97efc0 >2013-12-04 04:14:43,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f97efc0 >2013-12-04 04:14:43,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6dc6c4d6 >2013-12-04 04:14:43,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81aa2aa3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ad79458}, log id: 6dc6c4d6 >2013-12-04 04:14:48,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3f46a6e6 >2013-12-04 04:14:49,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f46a6e6 >2013-12-04 04:14:49,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 92d2b23 >2013-12-04 04:14:49,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@658f878e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e45fe2ac}, log id: 92d2b23 >2013-12-04 04:14:54,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66f8b278 >2013-12-04 04:14:54,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 66f8b278 >2013-12-04 04:14:54,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 13f9aa32 >2013-12-04 04:14:55,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bd94816, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b2ed2b7}, log id: 13f9aa32 >2013-12-04 04:14:57,585 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-7) No up server in cluster >2013-12-04 04:14:57,585 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-7) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:14:57,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75639bb9 >2013-12-04 04:14:57,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, return: [], log id: 75639bb9 >2013-12-04 04:15:00,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c436f5c >2013-12-04 04:15:00,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c436f5c >2013-12-04 04:15:00,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: a9934a0 >2013-12-04 04:15:01,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@695551a0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@623d4657}, log id: a9934a0 >2013-12-04 04:15:06,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9672c5f >2013-12-04 04:15:06,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 9672c5f >2013-12-04 04:15:06,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12e1a17a >2013-12-04 04:15:06,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca99e5c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddf35dad}, log id: 12e1a17a >2013-12-04 04:15:11,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 31dafec9 >2013-12-04 04:15:12,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31dafec9 >2013-12-04 04:15:12,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6d560662 >2013-12-04 04:15:12,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d27bce34, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84002bc0}, log id: 6d560662 >2013-12-04 04:15:17,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 404ea6fa >2013-12-04 04:15:18,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 404ea6fa >2013-12-04 04:15:18,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 49f79095 >2013-12-04 04:15:18,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b98a4263, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41d321b9}, log id: 49f79095 >2013-12-04 04:15:23,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 759461c3 >2013-12-04 04:15:24,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 759461c3 >2013-12-04 04:15:24,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 65a7bf52 >2013-12-04 04:15:24,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f15ed499, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce6927b0}, log id: 65a7bf52 >2013-12-04 04:15:29,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4525fdf >2013-12-04 04:15:29,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4525fdf >2013-12-04 04:15:29,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2abdceee >2013-12-04 04:15:30,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@120d18ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2efd127}, log id: 2abdceee >2013-12-04 04:15:35,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e4bb968 >2013-12-04 04:15:35,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e4bb968 >2013-12-04 04:15:35,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37ab103a >2013-12-04 04:15:36,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c95302e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfc0f064}, log id: 37ab103a >2013-12-04 04:15:41,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 58eb7ce >2013-12-04 04:15:41,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 58eb7ce >2013-12-04 04:15:41,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3034901d >2013-12-04 04:15:41,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@930076c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f21d0f9}, log id: 3034901d >2013-12-04 04:15:46,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 25d5035 >2013-12-04 04:15:47,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25d5035 >2013-12-04 04:15:47,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 329fa4dd >2013-12-04 04:15:47,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83ab3d2c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aabc2bcd}, log id: 329fa4dd >2013-12-04 04:15:52,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66cbaabc >2013-12-04 04:15:53,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 66cbaabc >2013-12-04 04:15:53,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29e92c28 >2013-12-04 04:15:53,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62e92d88, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@705d025a}, log id: 29e92c28 >2013-12-04 04:15:57,899 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-04 04:15:57,899 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:15:57,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7fdb9184 >2013-12-04 04:15:58,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7fdb9184 >2013-12-04 04:15:58,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a46d27 >2013-12-04 04:15:59,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a46d27 >2013-12-04 04:15:59,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 758adcde >2013-12-04 04:15:59,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82c128cc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e432851}, log id: 758adcde >2013-12-04 04:16:04,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f8e7d9c >2013-12-04 04:16:04,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5f8e7d9c >2013-12-04 04:16:04,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 31470150 >2013-12-04 04:16:05,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e35a57b0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3196656}, log id: 31470150 >2013-12-04 04:16:10,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 8d3b1fe >2013-12-04 04:16:10,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 8d3b1fe >2013-12-04 04:16:10,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 492d3fcf >2013-12-04 04:16:10,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f70cb7c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d4891f8}, log id: 492d3fcf >2013-12-04 04:16:15,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1cf7316c >2013-12-04 04:16:16,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1cf7316c >2013-12-04 04:16:16,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6781ee40 >2013-12-04 04:16:16,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31644b24, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba034165}, log id: 6781ee40 >2013-12-04 04:16:21,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f34dbbc >2013-12-04 04:16:22,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f34dbbc >2013-12-04 04:16:22,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 145eb3f0 >2013-12-04 04:16:22,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37f4150, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e3af167}, log id: 145eb3f0 >2013-12-04 04:16:27,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f4cc968 >2013-12-04 04:16:28,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f4cc968 >2013-12-04 04:16:28,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 71b12ae8 >2013-12-04 04:16:28,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbb01604, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97edbb29}, log id: 71b12ae8 >2013-12-04 04:16:33,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7048adb2 >2013-12-04 04:16:33,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7048adb2 >2013-12-04 04:16:33,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3eb61112 >2013-12-04 04:16:34,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae78219e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2f465f}, log id: 3eb61112 >2013-12-04 04:16:39,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d0cbb8f >2013-12-04 04:16:39,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d0cbb8f >2013-12-04 04:16:39,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f78e7b4 >2013-12-04 04:16:40,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b4c1d9b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8cc8390}, log id: 6f78e7b4 >2013-12-04 04:16:45,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7d622112 >2013-12-04 04:16:45,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d622112 >2013-12-04 04:16:45,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63a49e5c >2013-12-04 04:16:45,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc15d7ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9066c6f}, log id: 63a49e5c >2013-12-04 04:16:50,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5af3f3d8 >2013-12-04 04:16:51,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5af3f3d8 >2013-12-04 04:16:51,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6e010310 >2013-12-04 04:16:51,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d7c5f4e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7d8ffaf}, log id: 6e010310 >2013-12-04 04:16:56,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3944d1aa >2013-12-04 04:16:57,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3944d1aa >2013-12-04 04:16:57,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 598d3485 >2013-12-04 04:16:57,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cd12a60, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8f99601}, log id: 598d3485 >2013-12-04 04:16:58,241 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-04 04:16:58,241 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:16:58,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 639ff180 >2013-12-04 04:16:58,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 639ff180 >2013-12-04 04:17:02,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ba1d99f >2013-12-04 04:17:02,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ba1d99f >2013-12-04 04:17:02,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e840bc1 >2013-12-04 04:17:03,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4de1ae6a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63715946}, log id: 1e840bc1 >2013-12-04 04:17:08,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 415672b5 >2013-12-04 04:17:08,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 415672b5 >2013-12-04 04:17:08,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3a8e0f2c >2013-12-04 04:17:09,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fc06037, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a361433}, log id: 3a8e0f2c >2013-12-04 04:17:14,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 78d84023 >2013-12-04 04:17:14,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78d84023 >2013-12-04 04:17:14,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 11886697 >2013-12-04 04:17:14,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8186f4df, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72c31349}, log id: 11886697 >2013-12-04 04:17:19,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d30d9e >2013-12-04 04:17:20,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3d30d9e >2013-12-04 04:17:20,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d7f3651 >2013-12-04 04:17:20,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a660910f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1dd4a580}, log id: 3d7f3651 >2013-12-04 04:17:25,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d6f12a5 >2013-12-04 04:17:26,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d6f12a5 >2013-12-04 04:17:26,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 279104d0 >2013-12-04 04:17:26,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b632766, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e763099f}, log id: 279104d0 >2013-12-04 04:17:31,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59fea5e >2013-12-04 04:17:32,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 59fea5e >2013-12-04 04:17:32,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b83626f >2013-12-04 04:17:32,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90b8ecf8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26f742ad}, log id: 3b83626f >2013-12-04 04:17:37,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55428171 >2013-12-04 04:17:37,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 55428171 >2013-12-04 04:17:37,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46ca2ae >2013-12-04 04:17:38,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc84d4b1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@367ef440}, log id: 46ca2ae >2013-12-04 04:17:43,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a34c851 >2013-12-04 04:17:43,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a34c851 >2013-12-04 04:17:43,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 51666654 >2013-12-04 04:17:43,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1312cab5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bac58790}, log id: 51666654 >2013-12-04 04:17:48,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59a50eff >2013-12-04 04:17:49,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 59a50eff >2013-12-04 04:17:49,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c6d5f05 >2013-12-04 04:17:49,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38ae30b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47ae1f8}, log id: 4c6d5f05 >2013-12-04 04:17:54,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3840917f >2013-12-04 04:17:55,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3840917f >2013-12-04 04:17:55,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ee1859f >2013-12-04 04:17:55,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@262d6536, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8eaf070}, log id: ee1859f >2013-12-04 04:17:58,545 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) No up server in cluster >2013-12-04 04:17:58,546 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:17:58,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 587b8d34 >2013-12-04 04:17:58,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, return: [], log id: 587b8d34 >2013-12-04 04:18:00,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1f6be42f >2013-12-04 04:18:01,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f6be42f >2013-12-04 04:18:01,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 532e9e51 >2013-12-04 04:18:01,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c2e9ff8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a7e2da8}, log id: 532e9e51 >2013-12-04 04:18:06,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a068b79 >2013-12-04 04:18:06,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4a068b79 >2013-12-04 04:18:06,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: a583b1 >2013-12-04 04:18:07,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82191302, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80a5d875}, log id: a583b1 >2013-12-04 04:18:12,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4cbd4a40 >2013-12-04 04:18:12,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4cbd4a40 >2013-12-04 04:18:12,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 14291624 >2013-12-04 04:18:13,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d6f6f63, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7128a12c}, log id: 14291624 >2013-12-04 04:18:18,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6ba03f1d >2013-12-04 04:18:18,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ba03f1d >2013-12-04 04:18:18,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5208b65e >2013-12-04 04:18:18,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e366d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@262bdfe2}, log id: 5208b65e >2013-12-04 04:18:23,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e6e9274 >2013-12-04 04:18:24,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e6e9274 >2013-12-04 04:18:24,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d716acc >2013-12-04 04:18:24,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d99d36b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d15c0cc}, log id: 3d716acc >2013-12-04 04:18:29,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ced85fa >2013-12-04 04:18:30,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: ced85fa >2013-12-04 04:18:30,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 67149658 >2013-12-04 04:18:30,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f409c32f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d940c23c}, log id: 67149658 >2013-12-04 04:18:35,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7d011784 >2013-12-04 04:18:36,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d011784 >2013-12-04 04:18:36,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 321d1882 >2013-12-04 04:18:36,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cac3fbf5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c737146b}, log id: 321d1882 >2013-12-04 04:18:41,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6f002c63 >2013-12-04 04:18:41,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f002c63 >2013-12-04 04:18:41,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 661d8731 >2013-12-04 04:18:42,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0470122, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa0baf45}, log id: 661d8731 >2013-12-04 04:18:47,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fe41700 >2013-12-04 04:18:47,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2fe41700 >2013-12-04 04:18:47,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69a09e9 >2013-12-04 04:18:47,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbe1caa6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a812f447}, log id: 69a09e9 >2013-12-04 04:18:50,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70028d79 >2013-12-04 04:18:50,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1a1b688e, log id: 70028d79 >2013-12-04 04:18:50,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d6d5005 >2013-12-04 04:18:50,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4be8a178, log id: 7d6d5005 >2013-12-04 04:18:53,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 25c62c71 >2013-12-04 04:18:53,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25c62c71 >2013-12-04 04:18:53,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 697548b3 >2013-12-04 04:18:53,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f53c197, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff477f4d}, log id: 697548b3 >2013-12-04 04:18:58,851 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-77) No up server in cluster >2013-12-04 04:18:58,851 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-77) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:18:58,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4c9c1b13 >2013-12-04 04:18:58,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ee701ce >2013-12-04 04:18:59,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7ee701ce >2013-12-04 04:18:59,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c9c1b13 >2013-12-04 04:18:59,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7c0fd6ad >2013-12-04 04:18:59,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87a30aed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1965fcae}, log id: 7c0fd6ad >2013-12-04 04:19:04,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 28a5ab55 >2013-12-04 04:19:05,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28a5ab55 >2013-12-04 04:19:05,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 235813d1 >2013-12-04 04:19:05,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53814e8c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@471f453}, log id: 235813d1 >2013-12-04 04:19:10,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: a3b2989 >2013-12-04 04:19:11,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a3b2989 >2013-12-04 04:19:11,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3f9615af >2013-12-04 04:19:11,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eeed4965, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4426b141}, log id: 3f9615af >2013-12-04 04:19:16,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6d4e46ba >2013-12-04 04:19:16,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d4e46ba >2013-12-04 04:19:16,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 63b40e4e >2013-12-04 04:19:17,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25a32521, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e219e4b}, log id: 63b40e4e >2013-12-04 04:19:22,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73a752ab >2013-12-04 04:19:22,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 73a752ab >2013-12-04 04:19:22,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 407896e >2013-12-04 04:19:22,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b3d1346, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bcbc202}, log id: 407896e >2013-12-04 04:19:27,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 270a9e90 >2013-12-04 04:19:28,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 270a9e90 >2013-12-04 04:19:28,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 72a4cefc >2013-12-04 04:19:28,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7c1ece9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c6840bf}, log id: 72a4cefc >2013-12-04 04:19:33,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 73d85057 >2013-12-04 04:19:34,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 73d85057 >2013-12-04 04:19:34,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b58369f >2013-12-04 04:19:34,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab7c0757, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75ede5b0}, log id: 1b58369f >2013-12-04 04:19:39,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15682978 >2013-12-04 04:19:40,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 15682978 >2013-12-04 04:19:40,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5da2bfc0 >2013-12-04 04:19:40,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c636a97, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1af49ae4}, log id: 5da2bfc0 >2013-12-04 04:19:45,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5189cb68 >2013-12-04 04:19:45,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5189cb68 >2013-12-04 04:19:45,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 76aed214 >2013-12-04 04:19:46,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b46e34f4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@773769ed}, log id: 76aed214 >2013-12-04 04:19:51,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: e21e956 >2013-12-04 04:19:51,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e21e956 >2013-12-04 04:19:51,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5f6c4571 >2013-12-04 04:19:52,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8278bef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52c9e25a}, log id: 5f6c4571 >2013-12-04 04:19:57,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14df60a4 >2013-12-04 04:19:57,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 14df60a4 >2013-12-04 04:19:57,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 31a26a93 >2013-12-04 04:19:57,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b95c4d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5903508}, log id: 31a26a93 >2013-12-04 04:19:59,134 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) No up server in cluster >2013-12-04 04:19:59,134 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:19:59,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79e2019c >2013-12-04 04:19:59,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterTasksListVDSCommand, return: [], log id: 79e2019c >2013-12-04 04:20:02,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 158e4389 >2013-12-04 04:20:03,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 158e4389 >2013-12-04 04:20:03,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c71269f >2013-12-04 04:20:03,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd896d38, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a35b4d4b}, log id: 5c71269f >2013-12-04 04:20:08,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3e2b695a >2013-12-04 04:20:09,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e2b695a >2013-12-04 04:20:09,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 36bba823 >2013-12-04 04:20:09,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c9064b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7656101b}, log id: 36bba823 >2013-12-04 04:20:14,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1611b4de >2013-12-04 04:20:15,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1611b4de >2013-12-04 04:20:15,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1adc79fd >2013-12-04 04:20:15,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a3fcf58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea5c4d8f}, log id: 1adc79fd >2013-12-04 04:20:20,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3be3b581 >2013-12-04 04:20:20,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3be3b581 >2013-12-04 04:20:20,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ef8e58e >2013-12-04 04:20:21,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31eeda5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76ed581a}, log id: ef8e58e >2013-12-04 04:20:26,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b9562f6 >2013-12-04 04:20:26,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b9562f6 >2013-12-04 04:20:26,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 17dc056e >2013-12-04 04:20:26,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f748c79, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd188dbb}, log id: 17dc056e >2013-12-04 04:20:32,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 656fbfb3 >2013-12-04 04:20:32,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 656fbfb3 >2013-12-04 04:20:32,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a66afcc >2013-12-04 04:20:32,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4098f1ac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db2840a0}, log id: 1a66afcc >2013-12-04 04:20:37,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45cf8dec >2013-12-04 04:20:38,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 45cf8dec >2013-12-04 04:20:38,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68e2433f >2013-12-04 04:20:38,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ab17b97, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2adfe735}, log id: 68e2433f >2013-12-04 04:20:43,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6eaa8492 >2013-12-04 04:20:44,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6eaa8492 >2013-12-04 04:20:44,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4fe91656 >2013-12-04 04:20:44,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6198b0a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7393a36f}, log id: 4fe91656 >2013-12-04 04:20:49,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4769fcd0 >2013-12-04 04:20:49,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4769fcd0 >2013-12-04 04:20:49,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 162da09e >2013-12-04 04:20:50,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b128bf15, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32ce1e45}, log id: 162da09e >2013-12-04 04:20:55,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5bfc7054 >2013-12-04 04:20:55,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5bfc7054 >2013-12-04 04:20:55,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7afa6c43 >2013-12-04 04:20:56,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb005ea4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16671792}, log id: 7afa6c43 >2013-12-04 04:20:59,477 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-04 04:20:59,477 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:20:59,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5fea41bf >2013-12-04 04:20:59,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5fea41bf >2013-12-04 04:21:01,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 390e5ad0 >2013-12-04 04:21:01,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 390e5ad0 >2013-12-04 04:21:01,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57b6f9f8 >2013-12-04 04:21:01,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7747512, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a30b81eb}, log id: 57b6f9f8 >2013-12-04 04:21:06,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 66baa1db >2013-12-04 04:21:07,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 66baa1db >2013-12-04 04:21:07,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 13bc6adf >2013-12-04 04:21:07,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b6672e6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf8ed1a}, log id: 13bc6adf >2013-12-04 04:21:12,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 56fadf92 >2013-12-04 04:21:13,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56fadf92 >2013-12-04 04:21:13,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7d01fe15 >2013-12-04 04:21:13,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7eb136b4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a13ec01}, log id: 7d01fe15 >2013-12-04 04:21:18,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76eafc25 >2013-12-04 04:21:19,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 76eafc25 >2013-12-04 04:21:19,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 24f435ce >2013-12-04 04:21:19,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3b15b28, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@662e1228}, log id: 24f435ce >2013-12-04 04:21:24,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b04412b >2013-12-04 04:21:24,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4b04412b >2013-12-04 04:21:24,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38355a4f >2013-12-04 04:21:25,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b8a1137, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14c1fc49}, log id: 38355a4f >2013-12-04 04:21:30,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3617cc4d >2013-12-04 04:21:30,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3617cc4d >2013-12-04 04:21:30,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b670d9 >2013-12-04 04:21:30,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9de83fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c8da51a}, log id: 3b670d9 >2013-12-04 04:21:35,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b88fd24 >2013-12-04 04:21:36,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3b88fd24 >2013-12-04 04:21:36,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5e40bd2e >2013-12-04 04:21:36,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbceb3b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0ff7ea4}, log id: 5e40bd2e >2013-12-04 04:21:41,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2348dff5 >2013-12-04 04:21:42,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2348dff5 >2013-12-04 04:21:42,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4c20148e >2013-12-04 04:21:42,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0f21d15, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f20bfbac}, log id: 4c20148e >2013-12-04 04:21:47,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 16d2fba3 >2013-12-04 04:21:48,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16d2fba3 >2013-12-04 04:21:48,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 226f05d5 >2013-12-04 04:21:48,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b089bbd9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f1d7797}, log id: 226f05d5 >2013-12-04 04:21:53,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 158d700 >2013-12-04 04:21:53,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 158d700 >2013-12-04 04:21:53,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 745983c8 >2013-12-04 04:21:54,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca86b87c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f5594a6}, log id: 745983c8 >2013-12-04 04:21:59,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7acd9071 >2013-12-04 04:21:59,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7acd9071 >2013-12-04 04:21:59,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d63d10 >2013-12-04 04:21:59,773 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) No up server in cluster >2013-12-04 04:21:59,773 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:21:59,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 682ed9f3 >2013-12-04 04:21:59,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fccd6c27, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10cad314}, log id: 1d63d10 >2013-12-04 04:22:00,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, return: [], log id: 682ed9f3 >2013-12-04 04:22:05,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70228692 >2013-12-04 04:22:05,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 70228692 >2013-12-04 04:22:05,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6cffa660 >2013-12-04 04:22:05,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35749589, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4e01ba3}, log id: 6cffa660 >2013-12-04 04:22:10,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2267cb56 >2013-12-04 04:22:11,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2267cb56 >2013-12-04 04:22:11,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1ea0c33a >2013-12-04 04:22:11,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68a7024b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b7cb380}, log id: 1ea0c33a >2013-12-04 04:22:16,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1460c36d >2013-12-04 04:22:17,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1460c36d >2013-12-04 04:22:17,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 39aa0e0a >2013-12-04 04:22:17,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1dc5526, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98898a5e}, log id: 39aa0e0a >2013-12-04 04:22:22,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 136121fc >2013-12-04 04:22:22,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 136121fc >2013-12-04 04:22:22,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63acd2e7 >2013-12-04 04:22:23,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a2c810e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc05f068}, log id: 63acd2e7 >2013-12-04 04:22:28,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 56aec41e >2013-12-04 04:22:28,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 56aec41e >2013-12-04 04:22:28,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ebb9e5b >2013-12-04 04:22:29,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@397ce94, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@192c13fe}, log id: 1ebb9e5b >2013-12-04 04:22:34,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 48883925 >2013-12-04 04:22:34,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48883925 >2013-12-04 04:22:34,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1c2c6c87 >2013-12-04 04:22:34,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bfb16a4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a664837c}, log id: 1c2c6c87 >2013-12-04 04:22:39,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 653478ab >2013-12-04 04:22:40,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 653478ab >2013-12-04 04:22:40,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c795ebd >2013-12-04 04:22:40,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55608c5e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d11352bd}, log id: 2c795ebd >2013-12-04 04:22:45,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7b9c7b43 >2013-12-04 04:22:46,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b9c7b43 >2013-12-04 04:22:46,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 392f2aa1 >2013-12-04 04:22:46,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fadb73b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c905222}, log id: 392f2aa1 >2013-12-04 04:22:51,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6ed52893 >2013-12-04 04:22:52,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ed52893 >2013-12-04 04:22:52,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 49ca00ef >2013-12-04 04:22:52,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@829b8f69, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d143d757}, log id: 49ca00ef >2013-12-04 04:22:57,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c8d76fa >2013-12-04 04:22:57,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c8d76fa >2013-12-04 04:22:57,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 318fc2e9 >2013-12-04 04:22:58,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5811831, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9093835f}, log id: 318fc2e9 >2013-12-04 04:23:00,060 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) No up server in cluster >2013-12-04 04:23:00,060 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:23:00,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 757d6a1d >2013-12-04 04:23:00,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterTasksListVDSCommand, return: [], log id: 757d6a1d >2013-12-04 04:23:03,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19446b43 >2013-12-04 04:23:03,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 19446b43 >2013-12-04 04:23:03,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: c032815 >2013-12-04 04:23:03,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70d61436, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad3eabeb}, log id: c032815 >2013-12-04 04:23:08,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 471003ed >2013-12-04 04:23:09,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 471003ed >2013-12-04 04:23:09,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 48abce7d >2013-12-04 04:23:09,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ab8b402, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@716d2af5}, log id: 48abce7d >2013-12-04 04:23:14,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3e12f20e >2013-12-04 04:23:15,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e12f20e >2013-12-04 04:23:15,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e036edf >2013-12-04 04:23:15,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ed15b03, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4846f0c4}, log id: 4e036edf >2013-12-04 04:23:20,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b98e24d >2013-12-04 04:23:21,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b98e24d >2013-12-04 04:23:21,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4080a361 >2013-12-04 04:23:21,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2335b009, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a079387b}, log id: 4080a361 >2013-12-04 04:23:26,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 57652590 >2013-12-04 04:23:26,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 57652590 >2013-12-04 04:23:26,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 749b2930 >2013-12-04 04:23:27,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bee4490c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1411bb65}, log id: 749b2930 >2013-12-04 04:23:32,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 745f0e28 >2013-12-04 04:23:32,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 745f0e28 >2013-12-04 04:23:32,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c315a20 >2013-12-04 04:23:33,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1dd1325, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@711cec84}, log id: 6c315a20 >2013-12-04 04:23:38,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 447b8c7c >2013-12-04 04:23:38,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 447b8c7c >2013-12-04 04:23:38,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53b784e8 >2013-12-04 04:23:38,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25fe7f43, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e680c2c0}, log id: 53b784e8 >2013-12-04 04:23:43,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1d85acbf >2013-12-04 04:23:44,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d85acbf >2013-12-04 04:23:44,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 368274f1 >2013-12-04 04:23:44,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a73c220c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e85bd8d6}, log id: 368274f1 >2013-12-04 04:23:49,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 502ef986 >2013-12-04 04:23:50,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 502ef986 >2013-12-04 04:23:50,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f07eba4 >2013-12-04 04:23:50,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65deaaea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd06a6ce}, log id: 7f07eba4 >2013-12-04 04:23:50,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6319a10c >2013-12-04 04:23:51,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@75e07590, log id: 6319a10c >2013-12-04 04:23:51,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 63467d65 >2013-12-04 04:23:51,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3684ed37, log id: 63467d65 >2013-12-04 04:23:55,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57e4bc39 >2013-12-04 04:23:56,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 57e4bc39 >2013-12-04 04:23:56,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: f1af4e6 >2013-12-04 04:23:56,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2813cf9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ab0bb87}, log id: f1af4e6 >2013-12-04 04:24:00,359 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) No up server in cluster >2013-12-04 04:24:00,360 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:24:00,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ee13f73 >2013-12-04 04:24:00,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, return: [], log id: ee13f73 >2013-12-04 04:24:01,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17de432d >2013-12-04 04:24:01,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 17de432d >2013-12-04 04:24:01,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b9f426 >2013-12-04 04:24:02,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b423ebd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc7af613}, log id: 3b9f426 >2013-12-04 04:24:07,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 605b3b5d >2013-12-04 04:24:07,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 605b3b5d >2013-12-04 04:24:07,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2190e379 >2013-12-04 04:24:07,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cb778ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42b9e25b}, log id: 2190e379 >2013-12-04 04:24:12,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 741f511 >2013-12-04 04:24:13,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 741f511 >2013-12-04 04:24:13,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6327db29 >2013-12-04 04:24:13,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@662543d2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db3a623b}, log id: 6327db29 >2013-12-04 04:24:18,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41eb6d9c >2013-12-04 04:24:19,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 41eb6d9c >2013-12-04 04:24:19,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d28ca10 >2013-12-04 04:24:19,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7284bc4e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8294d0f}, log id: 2d28ca10 >2013-12-04 04:24:24,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2ca8e96c >2013-12-04 04:24:25,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ca8e96c >2013-12-04 04:24:25,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2d90fd5b >2013-12-04 04:24:25,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@112e316a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29d5bae0}, log id: 2d90fd5b >2013-12-04 04:24:30,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 712730c3 >2013-12-04 04:24:30,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 712730c3 >2013-12-04 04:24:30,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 200a1c67 >2013-12-04 04:24:31,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8381129, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f11f460}, log id: 200a1c67 >2013-12-04 04:24:36,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 49398c19 >2013-12-04 04:24:36,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 49398c19 >2013-12-04 04:24:36,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 592a373e >2013-12-04 04:24:36,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b601f625, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30138d1a}, log id: 592a373e >2013-12-04 04:24:41,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 79e5597e >2013-12-04 04:24:42,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79e5597e >2013-12-04 04:24:42,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 46878bd0 >2013-12-04 04:24:42,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ed48b2b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d8c3c9e}, log id: 46878bd0 >2013-12-04 04:24:47,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 9e9e72a >2013-12-04 04:24:48,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 9e9e72a >2013-12-04 04:24:48,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f336ea6 >2013-12-04 04:24:48,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fff8361b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b62ac85}, log id: 6f336ea6 >2013-12-04 04:24:53,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2719be33 >2013-12-04 04:24:54,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2719be33 >2013-12-04 04:24:54,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ea27e3f >2013-12-04 04:24:54,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d71b71cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cdcc1b3}, log id: ea27e3f >2013-12-04 04:24:59,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b51c12a >2013-12-04 04:24:59,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b51c12a >2013-12-04 04:24:59,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 357d968c >2013-12-04 04:25:00,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3770279f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b4be00c}, log id: 357d968c >2013-12-04 04:25:00,671 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-04 04:25:00,672 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:25:00,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 9d016e1 >2013-12-04 04:25:00,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 9d016e1 >2013-12-04 04:25:05,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6a76ce25 >2013-12-04 04:25:05,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a76ce25 >2013-12-04 04:25:05,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 668ece09 >2013-12-04 04:25:05,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f175fa5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b10b32}, log id: 668ece09 >2013-12-04 04:25:10,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: dd5616a >2013-12-04 04:25:11,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: dd5616a >2013-12-04 04:25:11,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 44352622 >2013-12-04 04:25:11,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bec2a632, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7806876d}, log id: 44352622 >2013-12-04 04:25:16,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6d7efd25 >2013-12-04 04:25:17,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6d7efd25 >2013-12-04 04:25:17,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5b74f4f4 >2013-12-04 04:25:17,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cc7517a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2033b0bf}, log id: 5b74f4f4 >2013-12-04 04:25:22,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3c5c3b2e >2013-12-04 04:25:23,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c5c3b2e >2013-12-04 04:25:23,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3792dd60 >2013-12-04 04:25:23,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28a19bc2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32462888}, log id: 3792dd60 >2013-12-04 04:25:28,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7b723f6c >2013-12-04 04:25:28,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7b723f6c >2013-12-04 04:25:28,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67498466 >2013-12-04 04:25:29,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7462a9e4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a095c22a}, log id: 67498466 >2013-12-04 04:25:34,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5df26f51 >2013-12-04 04:25:34,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5df26f51 >2013-12-04 04:25:34,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32834a20 >2013-12-04 04:25:35,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35f6057c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68130660}, log id: 32834a20 >2013-12-04 04:25:40,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 68cf992b >2013-12-04 04:25:40,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 68cf992b >2013-12-04 04:25:40,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 115899 >2013-12-04 04:25:40,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3700e56, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ab116a6}, log id: 115899 >2013-12-04 04:25:45,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6a7473e2 >2013-12-04 04:25:46,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a7473e2 >2013-12-04 04:25:46,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 548632cf >2013-12-04 04:25:46,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2dcff3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7634b505}, log id: 548632cf >2013-12-04 04:25:51,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75d3e4c0 >2013-12-04 04:25:52,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 75d3e4c0 >2013-12-04 04:25:52,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 210cc7c4 >2013-12-04 04:25:52,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ffef96a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bae3e7}, log id: 210cc7c4 >2013-12-04 04:25:57,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16ee3166 >2013-12-04 04:25:58,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 16ee3166 >2013-12-04 04:25:58,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a39eceb >2013-12-04 04:25:58,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff76d54e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7abbb84}, log id: 4a39eceb >2013-12-04 04:26:00,977 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-04 04:26:00,977 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:26:00,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 311d4610 >2013-12-04 04:26:01,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 311d4610 >2013-12-04 04:26:03,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a308be6 >2013-12-04 04:26:03,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a308be6 >2013-12-04 04:26:03,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41915a11 >2013-12-04 04:26:04,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16c8897f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3b01d65}, log id: 41915a11 >2013-12-04 04:26:09,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38c16a4 >2013-12-04 04:26:09,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 38c16a4 >2013-12-04 04:26:09,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7da20342 >2013-12-04 04:26:09,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@284df5d2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20e36978}, log id: 7da20342 >2013-12-04 04:26:15,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 25ac1a01 >2013-12-04 04:26:15,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25ac1a01 >2013-12-04 04:26:15,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 33713118 >2013-12-04 04:26:15,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@592d1629, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ede8988}, log id: 33713118 >2013-12-04 04:26:20,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 318f0f64 >2013-12-04 04:26:21,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 318f0f64 >2013-12-04 04:26:21,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 162a8f9b >2013-12-04 04:26:21,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a6979e7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d7836d0}, log id: 162a8f9b >2013-12-04 04:26:26,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 49dbe362 >2013-12-04 04:26:27,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 49dbe362 >2013-12-04 04:26:27,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 64c4444a >2013-12-04 04:26:27,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1611cf30, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12d7bb1}, log id: 64c4444a >2013-12-04 04:26:32,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5aa04bce >2013-12-04 04:26:32,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5aa04bce >2013-12-04 04:26:32,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12b2bd2b >2013-12-04 04:26:33,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7eddc510, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7970d00}, log id: 12b2bd2b >2013-12-04 04:26:38,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68eb3d43 >2013-12-04 04:26:38,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 68eb3d43 >2013-12-04 04:26:38,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5dacadcf >2013-12-04 04:26:39,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f02c9f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13c31176}, log id: 5dacadcf >2013-12-04 04:26:44,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4d126529 >2013-12-04 04:26:44,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d126529 >2013-12-04 04:26:44,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 44952c74 >2013-12-04 04:26:44,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ace6a77e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c00ec148}, log id: 44952c74 >2013-12-04 04:26:49,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 401bbe43 >2013-12-04 04:26:50,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 401bbe43 >2013-12-04 04:26:50,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3dbc8d4f >2013-12-04 04:26:50,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb3fd8d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2771ada}, log id: 3dbc8d4f >2013-12-04 04:26:55,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5399035e >2013-12-04 04:26:56,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5399035e >2013-12-04 04:26:56,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: fca824e >2013-12-04 04:26:56,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7ae5d3e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3dfba6f}, log id: fca824e >2013-12-04 04:27:01,290 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-04 04:27:01,291 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:27:01,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5261283a >2013-12-04 04:27:01,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 62076285 >2013-12-04 04:27:01,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5261283a >2013-12-04 04:27:02,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 62076285 >2013-12-04 04:27:02,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19d7af26 >2013-12-04 04:27:02,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2ea24ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4eac0dd4}, log id: 19d7af26 >2013-12-04 04:27:07,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1fa8cd15 >2013-12-04 04:27:07,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1fa8cd15 >2013-12-04 04:27:07,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 71a2061b >2013-12-04 04:27:08,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a12d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db71a795}, log id: 71a2061b >2013-12-04 04:27:13,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 65f8b17 >2013-12-04 04:27:13,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65f8b17 >2013-12-04 04:27:13,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: caca072 >2013-12-04 04:27:13,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c1b2ab1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75b7f9ca}, log id: caca072 >2013-12-04 04:27:19,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 274f6eb6 >2013-12-04 04:27:19,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 274f6eb6 >2013-12-04 04:27:19,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ea28d28 >2013-12-04 04:27:19,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89d69f4e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@546492a2}, log id: 7ea28d28 >2013-12-04 04:27:24,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6424f7de >2013-12-04 04:27:25,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6424f7de >2013-12-04 04:27:25,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 54e8ef37 >2013-12-04 04:27:25,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3b29e8e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3065cc52}, log id: 54e8ef37 >2013-12-04 04:27:30,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16b88f5b >2013-12-04 04:27:31,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 16b88f5b >2013-12-04 04:27:31,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5337ec05 >2013-12-04 04:27:31,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6032586e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf7e7570}, log id: 5337ec05 >2013-12-04 04:27:36,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 181ff13 >2013-12-04 04:27:36,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 181ff13 >2013-12-04 04:27:36,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: db43562 >2013-12-04 04:27:37,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f083370d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f71e94}, log id: db43562 >2013-12-04 04:27:42,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 106cd4a1 >2013-12-04 04:27:42,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 106cd4a1 >2013-12-04 04:27:42,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 466de9f6 >2013-12-04 04:27:42,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90d49887, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@858e4c37}, log id: 466de9f6 >2013-12-04 04:27:47,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39ffd050 >2013-12-04 04:27:48,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 39ffd050 >2013-12-04 04:27:48,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d137c22 >2013-12-04 04:27:48,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e48ad39a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90b05c64}, log id: 1d137c22 >2013-12-04 04:27:53,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 749307ce >2013-12-04 04:27:54,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 749307ce >2013-12-04 04:27:54,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2b271903 >2013-12-04 04:27:54,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66acd64f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ac66476}, log id: 2b271903 >2013-12-04 04:27:59,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 73b73b59 >2013-12-04 04:28:00,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 73b73b59 >2013-12-04 04:28:00,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 62d49fa >2013-12-04 04:28:00,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eca91537, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79554819}, log id: 62d49fa >2013-12-04 04:28:01,590 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) No up server in cluster >2013-12-04 04:28:01,590 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:28:01,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 98fec1c >2013-12-04 04:28:01,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterTasksListVDSCommand, return: [], log id: 98fec1c >2013-12-04 04:28:05,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 23eb5ffd >2013-12-04 04:28:06,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 23eb5ffd >2013-12-04 04:28:06,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38e86d1c >2013-12-04 04:28:06,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4746c914, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ff8003a}, log id: 38e86d1c >2013-12-04 04:28:11,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3a0bb6c3 >2013-12-04 04:28:11,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a0bb6c3 >2013-12-04 04:28:11,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 596bed01 >2013-12-04 04:28:12,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31cf22c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7bc6d03}, log id: 596bed01 >2013-12-04 04:28:17,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32385cd1 >2013-12-04 04:28:17,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 32385cd1 >2013-12-04 04:28:17,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 143f66ad >2013-12-04 04:28:17,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c1d7521, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e864db3}, log id: 143f66ad >2013-12-04 04:28:22,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4308069d >2013-12-04 04:28:23,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4308069d >2013-12-04 04:28:23,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1b767df1 >2013-12-04 04:28:23,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7ddb214, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c115b568}, log id: 1b767df1 >2013-12-04 04:28:28,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 747f5d35 >2013-12-04 04:28:29,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 747f5d35 >2013-12-04 04:28:29,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25c50d36 >2013-12-04 04:28:29,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15c647c4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75c8cf9}, log id: 25c50d36 >2013-12-04 04:28:34,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a6d815a >2013-12-04 04:28:35,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a6d815a >2013-12-04 04:28:35,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59e46fcb >2013-12-04 04:28:35,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@556e198, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5b73a6a}, log id: 59e46fcb >2013-12-04 04:28:40,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: a13e483 >2013-12-04 04:28:40,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a13e483 >2013-12-04 04:28:40,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 72263110 >2013-12-04 04:28:41,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3bd3282, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54242684}, log id: 72263110 >2013-12-04 04:28:46,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 35c6c216 >2013-12-04 04:28:46,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35c6c216 >2013-12-04 04:28:46,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6c19e318 >2013-12-04 04:28:47,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c578112a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53a1d3a0}, log id: 6c19e318 >2013-12-04 04:28:51,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 606bfa97 >2013-12-04 04:28:51,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2d846336, log id: 606bfa97 >2013-12-04 04:28:51,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4e8d8592 >2013-12-04 04:28:52,036 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-73) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 04:28:52,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@45292dcb, log id: 4e8d8592 >2013-12-04 04:28:52,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 127d8de6 >2013-12-04 04:28:52,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 127d8de6 >2013-12-04 04:28:52,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20b8e1b5 >2013-12-04 04:28:52,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ecbd8f60, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdb6bc19}, log id: 20b8e1b5 >2013-12-04 04:28:57,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7ff2a05d >2013-12-04 04:28:58,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ff2a05d >2013-12-04 04:28:58,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1cccb4f0 >2013-12-04 04:28:58,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2edf9e80, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d39ba6b}, log id: 1cccb4f0 >2013-12-04 04:29:01,889 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) No up server in cluster >2013-12-04 04:29:01,897 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:29:01,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 65db601d >2013-12-04 04:29:02,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterTasksListVDSCommand, return: [], log id: 65db601d >2013-12-04 04:29:03,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7cd4675f >2013-12-04 04:29:04,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7cd4675f >2013-12-04 04:29:04,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1055a499 >2013-12-04 04:29:04,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b113bcf8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@677a86e0}, log id: 1055a499 >2013-12-04 04:29:09,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7da11414 >2013-12-04 04:29:09,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7da11414 >2013-12-04 04:29:09,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 51e14040 >2013-12-04 04:29:10,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@166197af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@822db957}, log id: 51e14040 >2013-12-04 04:29:15,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 46f127cf >2013-12-04 04:29:15,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 46f127cf >2013-12-04 04:29:15,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: fbc83c5 >2013-12-04 04:29:16,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a00b1ed0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@837b482b}, log id: fbc83c5 >2013-12-04 04:29:21,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20905265 >2013-12-04 04:29:21,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 20905265 >2013-12-04 04:29:21,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59b2cee5 >2013-12-04 04:29:21,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65a6a05a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e442cf3d}, log id: 59b2cee5 >2013-12-04 04:29:26,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6cab0f6 >2013-12-04 04:29:27,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cab0f6 >2013-12-04 04:29:27,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4f1b9805 >2013-12-04 04:29:27,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c90d3b10, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65b811d8}, log id: 4f1b9805 >2013-12-04 04:29:32,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: fe9ffef >2013-12-04 04:29:33,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: fe9ffef >2013-12-04 04:29:33,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e4878a6 >2013-12-04 04:29:33,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e95f3370, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3af4307a}, log id: 5e4878a6 >2013-12-04 04:29:38,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3ce56c0f >2013-12-04 04:29:39,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ce56c0f >2013-12-04 04:29:39,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f22e118 >2013-12-04 04:29:39,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4849e76, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd986ef6}, log id: 1f22e118 >2013-12-04 04:29:44,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b0e75a1 >2013-12-04 04:29:44,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: b0e75a1 >2013-12-04 04:29:44,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4cd113b7 >2013-12-04 04:29:45,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af61cbc8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bc1bacf}, log id: 4cd113b7 >2013-12-04 04:29:50,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6473a7de >2013-12-04 04:29:50,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6473a7de >2013-12-04 04:29:50,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 615f8ed9 >2013-12-04 04:29:50,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0a842dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87d1dd41}, log id: 615f8ed9 >2013-12-04 04:29:55,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 230f7053 >2013-12-04 04:29:56,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 230f7053 >2013-12-04 04:29:56,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 8256eab >2013-12-04 04:29:56,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd91f084, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1dadf98b}, log id: 8256eab >2013-12-04 04:30:01,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7729ed48 >2013-12-04 04:30:02,197 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-04 04:30:02,197 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:30:02,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f7eb90e >2013-12-04 04:30:02,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7729ed48 >2013-12-04 04:30:02,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ba11e49 >2013-12-04 04:30:02,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4f7eb90e >2013-12-04 04:30:02,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8bc1c6e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48b54bb7}, log id: 6ba11e49 >2013-12-04 04:30:07,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7121a3c5 >2013-12-04 04:30:08,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7121a3c5 >2013-12-04 04:30:08,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 40c70ce2 >2013-12-04 04:30:08,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7edaebb3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91a9517f}, log id: 40c70ce2 >2013-12-04 04:30:13,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 52ccc1cf >2013-12-04 04:30:13,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52ccc1cf >2013-12-04 04:30:13,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5dd14110 >2013-12-04 04:30:14,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78629d25, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14fff733}, log id: 5dd14110 >2013-12-04 04:30:19,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e13a47a >2013-12-04 04:30:19,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e13a47a >2013-12-04 04:30:19,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f9791bf >2013-12-04 04:30:20,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82e286ff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3ba4e30}, log id: 7f9791bf >2013-12-04 04:30:25,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 16d08498 >2013-12-04 04:30:25,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16d08498 >2013-12-04 04:30:25,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 40113e8e >2013-12-04 04:30:25,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80e71ba2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f89341b8}, log id: 40113e8e >2013-12-04 04:30:30,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2fb9408b >2013-12-04 04:30:31,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fb9408b >2013-12-04 04:30:31,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4e035967 >2013-12-04 04:30:31,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dac49d66, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d08c50de}, log id: 4e035967 >2013-12-04 04:30:36,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6face456 >2013-12-04 04:30:37,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6face456 >2013-12-04 04:30:37,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4e431488 >2013-12-04 04:30:37,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da64e852, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf618078}, log id: 4e431488 >2013-12-04 04:30:42,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27246415 >2013-12-04 04:30:43,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 27246415 >2013-12-04 04:30:43,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 66be9cf0 >2013-12-04 04:30:43,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@903043c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3220fc29}, log id: 66be9cf0 >2013-12-04 04:30:48,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4823f07 >2013-12-04 04:30:48,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4823f07 >2013-12-04 04:30:48,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5c1ae490 >2013-12-04 04:30:49,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a67c9277, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b81702b}, log id: 5c1ae490 >2013-12-04 04:30:54,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e5c4a96 >2013-12-04 04:30:54,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e5c4a96 >2013-12-04 04:30:54,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6d18828a >2013-12-04 04:30:54,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc61fc0a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9548074}, log id: 6d18828a >2013-12-04 04:31:00,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3ac57c1e >2013-12-04 04:31:00,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ac57c1e >2013-12-04 04:31:00,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59029945 >2013-12-04 04:31:00,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6acbd292, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af4dc160}, log id: 59029945 >2013-12-04 04:31:02,491 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) No up server in cluster >2013-12-04 04:31:02,491 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:31:02,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 136b7996 >2013-12-04 04:31:02,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, return: [], log id: 136b7996 >2013-12-04 04:31:05,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 11bc006a >2013-12-04 04:31:06,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11bc006a >2013-12-04 04:31:06,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 11f2a876 >2013-12-04 04:31:06,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c60cca3b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@344a987b}, log id: 11f2a876 >2013-12-04 04:31:11,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 242ef6d0 >2013-12-04 04:31:12,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 242ef6d0 >2013-12-04 04:31:12,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 9f551d9 >2013-12-04 04:31:12,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d8fe26c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@912eec5e}, log id: 9f551d9 >2013-12-04 04:31:17,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67f09ebd >2013-12-04 04:31:17,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 67f09ebd >2013-12-04 04:31:17,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 33b8e20f >2013-12-04 04:31:18,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a19a518e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26a1cf28}, log id: 33b8e20f >2013-12-04 04:31:23,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6dbdc848 >2013-12-04 04:31:23,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6dbdc848 >2013-12-04 04:31:23,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27902d4c >2013-12-04 04:31:24,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4a7c848, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adeec880}, log id: 27902d4c >2013-12-04 04:31:29,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4bea9510 >2013-12-04 04:31:29,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bea9510 >2013-12-04 04:31:29,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2224f815 >2013-12-04 04:31:29,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@492ce5e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@461b23a}, log id: 2224f815 >2013-12-04 04:31:34,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54b24e89 >2013-12-04 04:31:35,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 54b24e89 >2013-12-04 04:31:35,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3181a06b >2013-12-04 04:31:35,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11b688e7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3e17785}, log id: 3181a06b >2013-12-04 04:31:40,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 291abb7f >2013-12-04 04:31:41,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 291abb7f >2013-12-04 04:31:41,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 56d472b4 >2013-12-04 04:31:41,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b53e6475, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ea5fa2a}, log id: 56d472b4 >2013-12-04 04:31:46,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43144123 >2013-12-04 04:31:47,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 43144123 >2013-12-04 04:31:47,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5d0fcb07 >2013-12-04 04:31:47,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54de18da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f23e94af}, log id: 5d0fcb07 >2013-12-04 04:31:52,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 684990b7 >2013-12-04 04:31:52,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 684990b7 >2013-12-04 04:31:52,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 36e23172 >2013-12-04 04:31:53,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cea0065d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22253c7d}, log id: 36e23172 >2013-12-04 04:31:58,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 51fd4b54 >2013-12-04 04:31:58,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 51fd4b54 >2013-12-04 04:31:58,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 22ae6c3c >2013-12-04 04:31:58,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f1aefd6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cdf1301}, log id: 22ae6c3c >2013-12-04 04:32:02,791 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-04 04:32:02,791 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:32:02,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 72533732 >2013-12-04 04:32:03,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 72533732 >2013-12-04 04:32:04,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ff41944 >2013-12-04 04:32:04,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: ff41944 >2013-12-04 04:32:04,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 316790a5 >2013-12-04 04:32:04,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a43f9969, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89d17968}, log id: 316790a5 >2013-12-04 04:32:09,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 169617b0 >2013-12-04 04:32:10,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 169617b0 >2013-12-04 04:32:10,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 696af6a8 >2013-12-04 04:32:10,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@484415d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50371d19}, log id: 696af6a8 >2013-12-04 04:32:15,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70d16eec >2013-12-04 04:32:16,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 70d16eec >2013-12-04 04:32:16,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 721b44c7 >2013-12-04 04:32:16,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7afe920, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@283f666b}, log id: 721b44c7 >2013-12-04 04:32:21,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6212bee3 >2013-12-04 04:32:21,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6212bee3 >2013-12-04 04:32:21,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1aba11e0 >2013-12-04 04:32:22,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7241b637, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@327ba66b}, log id: 1aba11e0 >2013-12-04 04:32:27,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d6d1439 >2013-12-04 04:32:27,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d6d1439 >2013-12-04 04:32:27,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2674f81b >2013-12-04 04:32:27,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@798108fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@162c2efc}, log id: 2674f81b >2013-12-04 04:32:33,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: a432b10 >2013-12-04 04:32:33,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: a432b10 >2013-12-04 04:32:33,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: eb5eff6 >2013-12-04 04:32:33,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fe4c291, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48b083b3}, log id: eb5eff6 >2013-12-04 04:32:38,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 52c3723d >2013-12-04 04:32:39,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 52c3723d >2013-12-04 04:32:39,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7c42c829 >2013-12-04 04:32:39,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6e6d036, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d4df22e}, log id: 7c42c829 >2013-12-04 04:32:44,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6194929d >2013-12-04 04:32:45,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6194929d >2013-12-04 04:32:45,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 19c3d347 >2013-12-04 04:32:45,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd413dcc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6060d00}, log id: 19c3d347 >2013-12-04 04:32:50,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 78f0d133 >2013-12-04 04:32:51,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78f0d133 >2013-12-04 04:32:51,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 529a7bed >2013-12-04 04:32:51,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c548547, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@268e89f0}, log id: 529a7bed >2013-12-04 04:32:56,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e90b8b1 >2013-12-04 04:32:56,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e90b8b1 >2013-12-04 04:32:56,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1279ba4f >2013-12-04 04:32:57,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@290aaa0e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e81cb076}, log id: 1279ba4f >2013-12-04 04:33:02,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5082c8e7 >2013-12-04 04:33:02,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5082c8e7 >2013-12-04 04:33:02,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54dc661f >2013-12-04 04:33:02,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d43b17ae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41729732}, log id: 54dc661f >2013-12-04 04:33:03,112 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) No up server in cluster >2013-12-04 04:33:03,112 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:33:03,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 8121bd0 >2013-12-04 04:33:03,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterTasksListVDSCommand, return: [], log id: 8121bd0 >2013-12-04 04:33:07,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1122f4e9 >2013-12-04 04:33:08,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1122f4e9 >2013-12-04 04:33:08,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e542f92 >2013-12-04 04:33:08,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bf744e6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@333ad1d}, log id: 2e542f92 >2013-12-04 04:33:13,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1200c727 >2013-12-04 04:33:14,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1200c727 >2013-12-04 04:33:14,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 51e1876b >2013-12-04 04:33:14,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbfb2e1d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6b60a7d}, log id: 51e1876b >2013-12-04 04:33:19,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a67fdb6 >2013-12-04 04:33:20,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a67fdb6 >2013-12-04 04:33:20,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53ec72e9 >2013-12-04 04:33:20,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3457aac2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ff4e599}, log id: 53ec72e9 >2013-12-04 04:33:25,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5fe9e024 >2013-12-04 04:33:25,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5fe9e024 >2013-12-04 04:33:25,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24090c39 >2013-12-04 04:33:26,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7fe7f99, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d79cb5}, log id: 24090c39 >2013-12-04 04:33:31,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f8ba179 >2013-12-04 04:33:31,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: f8ba179 >2013-12-04 04:33:31,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 457f1a19 >2013-12-04 04:33:31,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e7a9fc4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@761e6eb7}, log id: 457f1a19 >2013-12-04 04:33:36,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 635c60a6 >2013-12-04 04:33:37,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 635c60a6 >2013-12-04 04:33:37,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 30a379ee >2013-12-04 04:33:37,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72019cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e3fb288}, log id: 30a379ee >2013-12-04 04:33:42,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 527664b0 >2013-12-04 04:33:43,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 527664b0 >2013-12-04 04:33:43,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7db0e83e >2013-12-04 04:33:43,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e62040c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d25e171}, log id: 7db0e83e >2013-12-04 04:33:48,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6fa6bcaf >2013-12-04 04:33:49,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fa6bcaf >2013-12-04 04:33:49,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5ea5ce2e >2013-12-04 04:33:49,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41da84d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4af8d4fd}, log id: 5ea5ce2e >2013-12-04 04:33:52,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 17894095 >2013-12-04 04:33:52,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@27a10920, log id: 17894095 >2013-12-04 04:33:52,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d5e2833 >2013-12-04 04:33:52,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5822c07d, log id: 3d5e2833 >2013-12-04 04:33:54,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 597342c6 >2013-12-04 04:33:54,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 597342c6 >2013-12-04 04:33:54,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7d07b2ec >2013-12-04 04:33:55,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2485390, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a73788}, log id: 7d07b2ec >2013-12-04 04:34:00,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 60b7b10 >2013-12-04 04:34:00,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60b7b10 >2013-12-04 04:34:00,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 73fd35a9 >2013-12-04 04:34:00,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b21e7eae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@651db983}, log id: 73fd35a9 >2013-12-04 04:34:03,435 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-04 04:34:03,435 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:34:03,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 31f6ee6d >2013-12-04 04:34:03,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 31f6ee6d >2013-12-04 04:34:05,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6caeb7e >2013-12-04 04:34:06,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6caeb7e >2013-12-04 04:34:06,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f694986 >2013-12-04 04:34:06,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@487897bd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@616f1eb9}, log id: f694986 >2013-12-04 04:34:11,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1b4845fe >2013-12-04 04:34:12,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1b4845fe >2013-12-04 04:34:12,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 61935576 >2013-12-04 04:34:12,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ca205b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@725c96c3}, log id: 61935576 >2013-12-04 04:34:17,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e8f3a07 >2013-12-04 04:34:18,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e8f3a07 >2013-12-04 04:34:18,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4ee2ac51 >2013-12-04 04:34:18,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84abadb1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50f858af}, log id: 4ee2ac51 >2013-12-04 04:34:23,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1098bea9 >2013-12-04 04:34:23,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1098bea9 >2013-12-04 04:34:23,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 71784d0b >2013-12-04 04:34:24,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@681ea5aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebdeb704}, log id: 71784d0b >2013-12-04 04:34:29,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a817154 >2013-12-04 04:34:29,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4a817154 >2013-12-04 04:34:29,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: a5c87b3 >2013-12-04 04:34:30,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79a5d6dc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff01b82b}, log id: a5c87b3 >2013-12-04 04:34:35,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6efe2f8 >2013-12-04 04:34:35,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6efe2f8 >2013-12-04 04:34:35,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7156fa0d >2013-12-04 04:34:35,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91d7975f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bd96fdd}, log id: 7156fa0d >2013-12-04 04:34:40,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1af6c4d4 >2013-12-04 04:34:41,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1af6c4d4 >2013-12-04 04:34:41,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41ba365 >2013-12-04 04:34:41,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e8a13a2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f27e4f5}, log id: 41ba365 >2013-12-04 04:34:46,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5586c789 >2013-12-04 04:34:47,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5586c789 >2013-12-04 04:34:47,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45146370 >2013-12-04 04:34:47,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ef3400c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ddb2418}, log id: 45146370 >2013-12-04 04:34:52,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4eae809b >2013-12-04 04:34:53,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4eae809b >2013-12-04 04:34:53,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 109eece7 >2013-12-04 04:34:53,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86565c7e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8eea751b}, log id: 109eece7 >2013-12-04 04:34:58,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c13e8ba >2013-12-04 04:34:58,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c13e8ba >2013-12-04 04:34:58,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8a40b84 >2013-12-04 04:34:59,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6dc3626, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8680a8f3}, log id: 8a40b84 >2013-12-04 04:35:03,739 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-04 04:35:03,739 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:35:03,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: ac0f5f4 >2013-12-04 04:35:04,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: ac0f5f4 >2013-12-04 04:35:04,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14fd37c3 >2013-12-04 04:35:04,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 14fd37c3 >2013-12-04 04:35:04,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ce465ec >2013-12-04 04:35:04,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70d771a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9abfd20}, log id: 6ce465ec >2013-12-04 04:35:10,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2bf71bfb >2013-12-04 04:35:10,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bf71bfb >2013-12-04 04:35:10,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 486842a0 >2013-12-04 04:35:10,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@133d95d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d83a27}, log id: 486842a0 >2013-12-04 04:35:15,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 572181c7 >2013-12-04 04:35:16,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 572181c7 >2013-12-04 04:35:16,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 33ba4ba7 >2013-12-04 04:35:16,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ff8dc79, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61a2d2ca}, log id: 33ba4ba7 >2013-12-04 04:35:21,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a45997d >2013-12-04 04:35:22,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1a45997d >2013-12-04 04:35:22,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7578106 >2013-12-04 04:35:22,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58f6bec5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df3e6900}, log id: 7578106 >2013-12-04 04:35:27,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 227ca1ff >2013-12-04 04:35:27,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 227ca1ff >2013-12-04 04:35:27,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 30d6fed1 >2013-12-04 04:35:28,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62669281, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cd8dc5a}, log id: 30d6fed1 >2013-12-04 04:35:33,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25d96858 >2013-12-04 04:35:33,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 25d96858 >2013-12-04 04:35:33,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2feb0221 >2013-12-04 04:35:34,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f39a514f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec9c4180}, log id: 2feb0221 >2013-12-04 04:35:39,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 633de73 >2013-12-04 04:35:39,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 633de73 >2013-12-04 04:35:39,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 128c7ca8 >2013-12-04 04:35:39,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@578f5ff7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed2a4a85}, log id: 128c7ca8 >2013-12-04 04:35:44,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59c39ca9 >2013-12-04 04:35:45,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 59c39ca9 >2013-12-04 04:35:45,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2ba4e08f >2013-12-04 04:35:45,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bffaf53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42028d09}, log id: 2ba4e08f >2013-12-04 04:35:50,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14231b31 >2013-12-04 04:35:51,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 14231b31 >2013-12-04 04:35:51,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 569b146f >2013-12-04 04:35:51,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@209134e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a858ed0}, log id: 569b146f >2013-12-04 04:35:56,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 49299d8c >2013-12-04 04:35:57,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49299d8c >2013-12-04 04:35:57,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 280a7648 >2013-12-04 04:35:57,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b9c8cb9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d66606b4}, log id: 280a7648 >2013-12-04 04:36:02,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ca86884 >2013-12-04 04:36:02,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ca86884 >2013-12-04 04:36:02,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: bca2a3 >2013-12-04 04:36:03,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67ac9bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e221db9}, log id: bca2a3 >2013-12-04 04:36:04,037 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-61) No up server in cluster >2013-12-04 04:36:04,037 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-61) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:36:04,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ef42a86 >2013-12-04 04:36:04,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5ef42a86 >2013-12-04 04:36:08,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 16dd6270 >2013-12-04 04:36:08,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 16dd6270 >2013-12-04 04:36:08,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4da746e3 >2013-12-04 04:36:08,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@296c0638, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67a8775d}, log id: 4da746e3 >2013-12-04 04:36:13,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50077614 >2013-12-04 04:36:14,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 50077614 >2013-12-04 04:36:14,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35cc356d >2013-12-04 04:36:14,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54ebb63, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52e526e0}, log id: 35cc356d >2013-12-04 04:36:19,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5883d402 >2013-12-04 04:36:20,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5883d402 >2013-12-04 04:36:20,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 55449f62 >2013-12-04 04:36:20,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cec41fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95c080ba}, log id: 55449f62 >2013-12-04 04:36:25,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35d85a9 >2013-12-04 04:36:26,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 35d85a9 >2013-12-04 04:36:26,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6093d8f3 >2013-12-04 04:36:26,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6185c59, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a685fbf4}, log id: 6093d8f3 >2013-12-04 04:36:31,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: fcca92d >2013-12-04 04:36:31,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: fcca92d >2013-12-04 04:36:31,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4970ca61 >2013-12-04 04:36:32,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8586a45e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f30633}, log id: 4970ca61 >2013-12-04 04:36:37,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11ecc3dd >2013-12-04 04:36:37,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 11ecc3dd >2013-12-04 04:36:37,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41318d0d >2013-12-04 04:36:37,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0291aca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bf976c0}, log id: 41318d0d >2013-12-04 04:36:42,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1723b21e >2013-12-04 04:36:43,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1723b21e >2013-12-04 04:36:43,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 77955dfe >2013-12-04 04:36:43,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cab77de, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63b7d201}, log id: 77955dfe >2013-12-04 04:36:48,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 346740b6 >2013-12-04 04:36:49,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 346740b6 >2013-12-04 04:36:49,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 336b2126 >2013-12-04 04:36:49,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67d8916, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34ab25cc}, log id: 336b2126 >2013-12-04 04:36:54,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6cfa8ee0 >2013-12-04 04:36:55,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cfa8ee0 >2013-12-04 04:36:55,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2579e79e >2013-12-04 04:36:55,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75f04623, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ec73ea1}, log id: 2579e79e >2013-12-04 04:37:00,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 608db4ab >2013-12-04 04:37:00,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 608db4ab >2013-12-04 04:37:00,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76dd77e9 >2013-12-04 04:37:01,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbdbc86a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1ba15b5}, log id: 76dd77e9 >2013-12-04 04:37:04,357 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) No up server in cluster >2013-12-04 04:37:04,357 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:37:04,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5fa3cfab >2013-12-04 04:37:04,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5fa3cfab >2013-12-04 04:37:06,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 62ff17aa >2013-12-04 04:37:06,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 62ff17aa >2013-12-04 04:37:06,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a29c520 >2013-12-04 04:37:07,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb8ecf0f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9760eb63}, log id: 7a29c520 >2013-12-04 04:37:12,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66273887 >2013-12-04 04:37:12,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 66273887 >2013-12-04 04:37:12,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4850d69c >2013-12-04 04:37:12,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6f751ad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6b05095}, log id: 4850d69c >2013-12-04 04:37:17,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34c885e2 >2013-12-04 04:37:18,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 34c885e2 >2013-12-04 04:37:18,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76dde236 >2013-12-04 04:37:18,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6b7a607, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59893076}, log id: 76dde236 >2013-12-04 04:37:23,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6cd4f08e >2013-12-04 04:37:24,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6cd4f08e >2013-12-04 04:37:24,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5481b634 >2013-12-04 04:37:24,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d43aeddf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b793f004}, log id: 5481b634 >2013-12-04 04:37:29,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1aadfc65 >2013-12-04 04:37:30,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1aadfc65 >2013-12-04 04:37:30,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e2325a4 >2013-12-04 04:37:30,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f7d3bab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@155e0f6f}, log id: 7e2325a4 >2013-12-04 04:37:35,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 708560a8 >2013-12-04 04:37:35,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 708560a8 >2013-12-04 04:37:35,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a45cd36 >2013-12-04 04:37:36,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d674717, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5271771d}, log id: 7a45cd36 >2013-12-04 04:37:41,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 597c3255 >2013-12-04 04:37:41,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 597c3255 >2013-12-04 04:37:41,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 43744514 >2013-12-04 04:37:41,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc69619e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53de4285}, log id: 43744514 >2013-12-04 04:37:46,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59649e97 >2013-12-04 04:37:47,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 59649e97 >2013-12-04 04:37:47,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 730de20 >2013-12-04 04:37:47,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be88aff4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fa2a814}, log id: 730de20 >2013-12-04 04:37:52,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a8208f3 >2013-12-04 04:37:53,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a8208f3 >2013-12-04 04:37:53,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57c7d2bc >2013-12-04 04:37:53,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b51b0a0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c54367a4}, log id: 57c7d2bc >2013-12-04 04:37:58,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 68decb3d >2013-12-04 04:37:59,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 68decb3d >2013-12-04 04:37:59,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3def0d08 >2013-12-04 04:37:59,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb292e0c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13526663}, log id: 3def0d08 >2013-12-04 04:38:04,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e9768da >2013-12-04 04:38:04,657 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [54e92961] No up server in cluster >2013-12-04 04:38:04,657 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [54e92961] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:38:04,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 21c157d8 >2013-12-04 04:38:04,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2e9768da >2013-12-04 04:38:04,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47227e5e >2013-12-04 04:38:04,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterTasksListVDSCommand, return: [], log id: 21c157d8 >2013-12-04 04:38:05,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5a41fbf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7c8a3e8}, log id: 47227e5e >2013-12-04 04:38:10,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6eb7d4f0 >2013-12-04 04:38:10,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6eb7d4f0 >2013-12-04 04:38:10,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20ccb501 >2013-12-04 04:38:10,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98de87f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f027a8c}, log id: 20ccb501 >2013-12-04 04:38:15,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 26c3e94a >2013-12-04 04:38:16,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 26c3e94a >2013-12-04 04:38:16,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 16a69e4 >2013-12-04 04:38:16,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54ff232a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73928edc}, log id: 16a69e4 >2013-12-04 04:38:21,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4e3b8b83 >2013-12-04 04:38:22,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4e3b8b83 >2013-12-04 04:38:22,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42d5ce2d >2013-12-04 04:38:22,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b378911c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f01e4354}, log id: 42d5ce2d >2013-12-04 04:38:27,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f1c9cfb >2013-12-04 04:38:28,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5f1c9cfb >2013-12-04 04:38:28,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 631a7709 >2013-12-04 04:38:28,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97b81dc8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b2af736}, log id: 631a7709 >2013-12-04 04:38:33,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 727db00b >2013-12-04 04:38:33,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 727db00b >2013-12-04 04:38:33,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6e3206a2 >2013-12-04 04:38:34,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a46d0bf5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b2afc9}, log id: 6e3206a2 >2013-12-04 04:38:36,708 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2013-12-04 04:38:36,772 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-52) Start refreshing all users data >2013-12-04 04:38:38,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-49) START, GlusterHooksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f7c0f63 >2013-12-04 04:38:38,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-30) START, GlusterHooksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1b183a87 >2013-12-04 04:38:38,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-16) START, GlusterHooksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 53aa82f6 >2013-12-04 04:38:38,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-14) START, GlusterHooksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6220f706 >2013-12-04 04:38:38,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-16) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@642a1b69, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f345860b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4913bcf2, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@8dab22d7, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ecaa7010, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@638f82dd, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a23a4958], log id: 53aa82f6 >2013-12-04 04:38:38,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-30) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@84e0fd2a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@bcc22840, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ca514eb3, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f7aa6850, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@882b7176, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5218b024, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4ff63240], log id: 1b183a87 >2013-12-04 04:38:38,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-49) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a9f72c2c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b179fca6, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b746dc79, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4cf4d1b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@38a1338, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@40b192a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@12f3f0e9], log id: 5f7c0f63 >2013-12-04 04:38:38,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-14) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@896d730, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@73495e4, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@fd6eefd4, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@9543e44f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@29fb0666, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3c59c2c3, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@364d0f1c], log id: 6220f706 >2013-12-04 04:38:39,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5239b8a6 >2013-12-04 04:38:39,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5239b8a6 >2013-12-04 04:38:39,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b4d48b4 >2013-12-04 04:38:40,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c9cd8e5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5b2291b}, log id: 1b4d48b4 >2013-12-04 04:38:45,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58c99217 >2013-12-04 04:38:45,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 58c99217 >2013-12-04 04:38:45,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f122f07 >2013-12-04 04:38:45,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4217c7e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9058a862}, log id: 1f122f07 >2013-12-04 04:38:50,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 225050de >2013-12-04 04:38:51,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 225050de >2013-12-04 04:38:51,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d704886 >2013-12-04 04:38:51,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13014a79, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3abe25b2}, log id: d704886 >2013-12-04 04:38:52,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d752269 >2013-12-04 04:38:53,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6f57aaf4, log id: 3d752269 >2013-12-04 04:38:53,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6498b247 >2013-12-04 04:38:53,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7e4d755, log id: 6498b247 >2013-12-04 04:38:56,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39ad71c8 >2013-12-04 04:38:57,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 39ad71c8 >2013-12-04 04:38:57,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78e0929e >2013-12-04 04:38:57,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86f5ee55, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@456779a6}, log id: 78e0929e >2013-12-04 04:39:02,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 673fe7bb >2013-12-04 04:39:02,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 673fe7bb >2013-12-04 04:39:02,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5f1a3690 >2013-12-04 04:39:03,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2405d2b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f5d7359}, log id: 5f1a3690 >2013-12-04 04:39:04,951 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-04 04:39:04,951 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:39:04,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 65542729 >2013-12-04 04:39:05,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [], log id: 65542729 >2013-12-04 04:39:08,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3449847e >2013-12-04 04:39:08,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3449847e >2013-12-04 04:39:08,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 300edf50 >2013-12-04 04:39:09,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfe75bc8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fbe6f6}, log id: 300edf50 >2013-12-04 04:39:14,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47e44d3b >2013-12-04 04:39:14,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 47e44d3b >2013-12-04 04:39:14,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 798d57d4 >2013-12-04 04:39:14,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4893fc17, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c33a7c78}, log id: 798d57d4 >2013-12-04 04:39:19,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 33b6ee41 >2013-12-04 04:39:20,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 33b6ee41 >2013-12-04 04:39:20,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2bdb1077 >2013-12-04 04:39:20,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89060acf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e10d7f28}, log id: 2bdb1077 >2013-12-04 04:39:25,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7bbb5ab4 >2013-12-04 04:39:26,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7bbb5ab4 >2013-12-04 04:39:26,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3230b867 >2013-12-04 04:39:26,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67a02eb9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92ce9b4a}, log id: 3230b867 >2013-12-04 04:39:31,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ebd9a56 >2013-12-04 04:39:32,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ebd9a56 >2013-12-04 04:39:32,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36e36f57 >2013-12-04 04:39:32,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1f55f44, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87834a78}, log id: 36e36f57 >2013-12-04 04:39:37,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5213d44d >2013-12-04 04:39:37,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5213d44d >2013-12-04 04:39:37,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 19b1dc52 >2013-12-04 04:39:38,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3970e2cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7887243}, log id: 19b1dc52 >2013-12-04 04:39:43,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7f4371bd >2013-12-04 04:39:43,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f4371bd >2013-12-04 04:39:43,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1d13f984 >2013-12-04 04:39:44,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@172818e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e39659c}, log id: 1d13f984 >2013-12-04 04:39:49,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 558f8292 >2013-12-04 04:39:49,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 558f8292 >2013-12-04 04:39:49,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2bb3c419 >2013-12-04 04:39:49,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1ca189d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8220ae84}, log id: 2bb3c419 >2013-12-04 04:39:54,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 487a7b36 >2013-12-04 04:39:55,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 487a7b36 >2013-12-04 04:39:55,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1004ebff >2013-12-04 04:39:55,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d3a1f50, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf376b47}, log id: 1004ebff >2013-12-04 04:40:00,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6eff6193 >2013-12-04 04:40:01,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6eff6193 >2013-12-04 04:40:01,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5c627663 >2013-12-04 04:40:01,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a89347f6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c8a596e}, log id: 5c627663 >2013-12-04 04:40:05,269 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-04 04:40:05,270 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:40:05,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1aa1fb0e >2013-12-04 04:40:05,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1aa1fb0e >2013-12-04 04:40:06,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 17f6cac9 >2013-12-04 04:40:07,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 17f6cac9 >2013-12-04 04:40:07,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d9055b8 >2013-12-04 04:40:07,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fc524dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59d6660d}, log id: 2d9055b8 >2013-12-04 04:40:12,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 443e9e57 >2013-12-04 04:40:12,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 443e9e57 >2013-12-04 04:40:12,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2286fde6 >2013-12-04 04:40:13,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c771195, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e100169}, log id: 2286fde6 >2013-12-04 04:40:18,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 370c4675 >2013-12-04 04:40:18,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 370c4675 >2013-12-04 04:40:18,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c4671a >2013-12-04 04:40:18,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d0a8bea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f63dac56}, log id: 5c4671a >2013-12-04 04:40:23,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6074c3e >2013-12-04 04:40:24,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6074c3e >2013-12-04 04:40:24,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4211819 >2013-12-04 04:40:24,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc0fffa9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9792d4b}, log id: 4211819 >2013-12-04 04:40:29,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7954d82f >2013-12-04 04:40:30,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7954d82f >2013-12-04 04:40:30,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 33285d0c >2013-12-04 04:40:30,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92659585, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@208cabda}, log id: 33285d0c >2013-12-04 04:40:35,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3f4f3a37 >2013-12-04 04:40:36,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f4f3a37 >2013-12-04 04:40:36,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a925046 >2013-12-04 04:40:36,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94e95400, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@732c60bf}, log id: 3a925046 >2013-12-04 04:40:41,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 26c92a66 >2013-12-04 04:40:41,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 26c92a66 >2013-12-04 04:40:41,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 66b5a793 >2013-12-04 04:40:42,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34351d84, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2019bd43}, log id: 66b5a793 >2013-12-04 04:40:47,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7d0b81bf >2013-12-04 04:40:47,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d0b81bf >2013-12-04 04:40:47,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4dfc4e36 >2013-12-04 04:40:48,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90fb7654, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c9ff8cc}, log id: 4dfc4e36 >2013-12-04 04:40:53,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a57eb1b >2013-12-04 04:40:53,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4a57eb1b >2013-12-04 04:40:53,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a9c650f >2013-12-04 04:40:53,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d569812a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6459878}, log id: 7a9c650f >2013-12-04 04:40:58,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b470e2d >2013-12-04 04:40:59,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b470e2d >2013-12-04 04:40:59,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 11d80cd2 >2013-12-04 04:40:59,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4fd420f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca917313}, log id: 11d80cd2 >2013-12-04 04:41:04,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 503c7b7f >2013-12-04 04:41:05,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 503c7b7f >2013-12-04 04:41:05,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70977733 >2013-12-04 04:41:05,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8934575, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@227f88bc}, log id: 70977733 >2013-12-04 04:41:05,565 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-04 04:41:05,565 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:41:05,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74c722a0 >2013-12-04 04:41:05,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: 74c722a0 >2013-12-04 04:41:10,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 73d55408 >2013-12-04 04:41:11,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73d55408 >2013-12-04 04:41:11,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4de24d8 >2013-12-04 04:41:11,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e1cf651, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c89e2c8}, log id: 4de24d8 >2013-12-04 04:41:16,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 65951306 >2013-12-04 04:41:16,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65951306 >2013-12-04 04:41:16,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 513e55ad >2013-12-04 04:41:17,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd01200f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa18b586}, log id: 513e55ad >2013-12-04 04:41:22,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5895504c >2013-12-04 04:41:22,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5895504c >2013-12-04 04:41:22,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 709f004a >2013-12-04 04:41:22,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b154bd6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4a4e3e3}, log id: 709f004a >2013-12-04 04:41:28,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 58a0a19e >2013-12-04 04:41:28,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 58a0a19e >2013-12-04 04:41:28,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e5ba4ea >2013-12-04 04:41:28,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86c3fc40, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c4a9c5a}, log id: 7e5ba4ea >2013-12-04 04:41:33,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7415b507 >2013-12-04 04:41:34,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7415b507 >2013-12-04 04:41:34,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7162cb31 >2013-12-04 04:41:34,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@636249a1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18bf3a7a}, log id: 7162cb31 >2013-12-04 04:41:39,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 42932e51 >2013-12-04 04:41:40,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 42932e51 >2013-12-04 04:41:40,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a6c374b >2013-12-04 04:41:40,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbd0d7e5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdcf3250}, log id: 4a6c374b >2013-12-04 04:41:45,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59e3a780 >2013-12-04 04:41:45,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 59e3a780 >2013-12-04 04:41:45,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6625f3c6 >2013-12-04 04:41:46,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7336273d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f55404fc}, log id: 6625f3c6 >2013-12-04 04:41:51,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 15f05030 >2013-12-04 04:41:51,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 15f05030 >2013-12-04 04:41:51,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6e228c3c >2013-12-04 04:41:52,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b190f262, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c329f0e4}, log id: 6e228c3c >2013-12-04 04:41:57,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 798dae43 >2013-12-04 04:41:57,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 798dae43 >2013-12-04 04:41:57,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3501650e >2013-12-04 04:41:57,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77ccb087, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d9aa408}, log id: 3501650e >2013-12-04 04:42:03,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 482993f8 >2013-12-04 04:42:03,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 482993f8 >2013-12-04 04:42:03,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 12a57982 >2013-12-04 04:42:03,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@748b61e2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cedafc5b}, log id: 12a57982 >2013-12-04 04:42:05,869 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-38) No up server in cluster >2013-12-04 04:42:05,869 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-38) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:42:05,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61413673 >2013-12-04 04:42:06,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterTasksListVDSCommand, return: [], log id: 61413673 >2013-12-04 04:42:08,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c9d4d19 >2013-12-04 04:42:09,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c9d4d19 >2013-12-04 04:42:09,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5728dd50 >2013-12-04 04:42:09,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87be8c2d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ad26185}, log id: 5728dd50 >2013-12-04 04:42:14,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3336629 >2013-12-04 04:42:15,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3336629 >2013-12-04 04:42:15,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 49368ec5 >2013-12-04 04:42:15,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9eebf792, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36fe15d5}, log id: 49368ec5 >2013-12-04 04:42:20,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b092efb >2013-12-04 04:42:20,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3b092efb >2013-12-04 04:42:20,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6b604fb9 >2013-12-04 04:42:21,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1437604, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0363c4d}, log id: 6b604fb9 >2013-12-04 04:42:26,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6dfc59f8 >2013-12-04 04:42:26,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6dfc59f8 >2013-12-04 04:42:26,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c456b78 >2013-12-04 04:42:27,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc98b2da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1522517f}, log id: 3c456b78 >2013-12-04 04:42:32,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 64bf7362 >2013-12-04 04:42:32,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64bf7362 >2013-12-04 04:42:32,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: c521a5e >2013-12-04 04:42:32,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b99bbb87, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@320b0a0b}, log id: c521a5e >2013-12-04 04:42:37,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 285c5007 >2013-12-04 04:42:38,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 285c5007 >2013-12-04 04:42:38,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2fb0e3d4 >2013-12-04 04:42:38,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c44ca459, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b88e87e1}, log id: 2fb0e3d4 >2013-12-04 04:42:43,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 711dd623 >2013-12-04 04:42:44,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 711dd623 >2013-12-04 04:42:44,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e7e1803 >2013-12-04 04:42:44,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b12279ca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46ac079e}, log id: 3e7e1803 >2013-12-04 04:42:49,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3682cf01 >2013-12-04 04:42:50,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3682cf01 >2013-12-04 04:42:50,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 60f26c8 >2013-12-04 04:42:50,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2e4f152, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@393d8313}, log id: 60f26c8 >2013-12-04 04:42:55,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2a38df2f >2013-12-04 04:42:55,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a38df2f >2013-12-04 04:42:55,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 335599ff >2013-12-04 04:42:56,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9159dcb1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a44df04}, log id: 335599ff >2013-12-04 04:43:01,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 42ae0c33 >2013-12-04 04:43:01,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 42ae0c33 >2013-12-04 04:43:01,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d66daa5 >2013-12-04 04:43:01,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfb01551, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a7f9269}, log id: d66daa5 >2013-12-04 04:43:06,177 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-04 04:43:06,177 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:43:06,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 65a02c88 >2013-12-04 04:43:06,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 65a02c88 >2013-12-04 04:43:06,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3b26f1e >2013-12-04 04:43:07,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b26f1e >2013-12-04 04:43:07,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: dfa4b0a >2013-12-04 04:43:07,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f173656, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@780b44dd}, log id: dfa4b0a >2013-12-04 04:43:12,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a991e66 >2013-12-04 04:43:13,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a991e66 >2013-12-04 04:43:13,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3fb2f3ec >2013-12-04 04:43:13,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96926c77, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92c22eac}, log id: 3fb2f3ec >2013-12-04 04:43:18,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 33e14250 >2013-12-04 04:43:19,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 33e14250 >2013-12-04 04:43:19,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c527aa5 >2013-12-04 04:43:19,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0bea186, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e69195d5}, log id: 1c527aa5 >2013-12-04 04:43:24,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 531fc2e5 >2013-12-04 04:43:24,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 531fc2e5 >2013-12-04 04:43:24,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3b1ee6a6 >2013-12-04 04:43:25,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9e17470, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef08c9df}, log id: 3b1ee6a6 >2013-12-04 04:43:30,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3a4d8fbc >2013-12-04 04:43:30,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3a4d8fbc >2013-12-04 04:43:30,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 577a0dec >2013-12-04 04:43:31,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b00d8c8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c95a6394}, log id: 577a0dec >2013-12-04 04:43:36,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 463f1240 >2013-12-04 04:43:36,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 463f1240 >2013-12-04 04:43:36,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d18445a >2013-12-04 04:43:36,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38552291, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81aa95b8}, log id: 2d18445a >2013-12-04 04:43:41,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7a05ca51 >2013-12-04 04:43:42,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a05ca51 >2013-12-04 04:43:42,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 50de6f8c >2013-12-04 04:43:42,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e476ac6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43d0e1b1}, log id: 50de6f8c >2013-12-04 04:43:47,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4174c058 >2013-12-04 04:43:48,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4174c058 >2013-12-04 04:43:48,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a5843ea >2013-12-04 04:43:48,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fbc71ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bca11ab}, log id: 3a5843ea >2013-12-04 04:43:53,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d838358 >2013-12-04 04:43:53,465 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-92) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 04:43:53,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6bd1def1, log id: 4d838358 >2013-12-04 04:43:53,628 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-5) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 04:43:53,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f83d784 >2013-12-04 04:43:54,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f83d784 >2013-12-04 04:43:54,139 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-5) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 04:43:54,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d0aa119 >2013-12-04 04:43:54,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7e5109d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b03f3eb3}, log id: 1d0aa119 >2013-12-04 04:43:54,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 26e09f8c >2013-12-04 04:43:54,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4101f070, log id: 26e09f8c >2013-12-04 04:43:59,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 254be4eb >2013-12-04 04:43:59,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 254be4eb >2013-12-04 04:43:59,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77b30aaf >2013-12-04 04:44:00,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35b59866, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6521cfb}, log id: 77b30aaf >2013-12-04 04:44:05,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24ca01fe >2013-12-04 04:44:05,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 24ca01fe >2013-12-04 04:44:05,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5b3bb4d1 >2013-12-04 04:44:06,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66c18f75, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5abc62a0}, log id: 5b3bb4d1 >2013-12-04 04:44:06,481 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-04 04:44:06,481 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:44:06,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 48a1ae42 >2013-12-04 04:44:06,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 48a1ae42 >2013-12-04 04:44:11,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e644bbd >2013-12-04 04:44:11,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3e644bbd >2013-12-04 04:44:11,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 71467a7c >2013-12-04 04:44:11,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2823294, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bd6cbc6}, log id: 71467a7c >2013-12-04 04:44:16,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3bda9210 >2013-12-04 04:44:17,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bda9210 >2013-12-04 04:44:17,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61d46b49 >2013-12-04 04:44:17,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cbb2e49, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2838f3c}, log id: 61d46b49 >2013-12-04 04:44:22,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b0ccff8 >2013-12-04 04:44:23,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: b0ccff8 >2013-12-04 04:44:23,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 690440a7 >2013-12-04 04:44:23,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5935ef8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91767565}, log id: 690440a7 >2013-12-04 04:44:28,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 513b7707 >2013-12-04 04:44:28,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 513b7707 >2013-12-04 04:44:28,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d2e5cbd >2013-12-04 04:44:29,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1de4868b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@332b6f43}, log id: 1d2e5cbd >2013-12-04 04:44:34,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 42baa941 >2013-12-04 04:44:34,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 42baa941 >2013-12-04 04:44:34,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3325b252 >2013-12-04 04:44:35,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b6e2635, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bddd539}, log id: 3325b252 >2013-12-04 04:44:40,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6fa6b115 >2013-12-04 04:44:40,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fa6b115 >2013-12-04 04:44:40,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 645ed768 >2013-12-04 04:44:40,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2774c058, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55ebe44a}, log id: 645ed768 >2013-12-04 04:44:45,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a8a7fbd >2013-12-04 04:44:46,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1a8a7fbd >2013-12-04 04:44:46,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4efaaeac >2013-12-04 04:44:46,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63ba9643, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e82b1ac7}, log id: 4efaaeac >2013-12-04 04:44:51,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 76836ba6 >2013-12-04 04:44:52,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76836ba6 >2013-12-04 04:44:52,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 64c0ea75 >2013-12-04 04:44:52,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f410ac6b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@413dc0a}, log id: 64c0ea75 >2013-12-04 04:44:57,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d1d41ec >2013-12-04 04:44:58,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2d1d41ec >2013-12-04 04:44:58,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: c21c1b6 >2013-12-04 04:44:58,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f3c294e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38b5c10e}, log id: c21c1b6 >2013-12-04 04:45:03,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 11d17dea >2013-12-04 04:45:03,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11d17dea >2013-12-04 04:45:03,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 18e0db4a >2013-12-04 04:45:04,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@456a965f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adda2b4c}, log id: 18e0db4a >2013-12-04 04:45:06,793 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) [451f957d] No up server in cluster >2013-12-04 04:45:06,793 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) [451f957d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:45:06,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 48631386 >2013-12-04 04:45:07,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 48631386 >2013-12-04 04:45:09,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1e4b1704 >2013-12-04 04:45:09,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e4b1704 >2013-12-04 04:45:09,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 685b6f38 >2013-12-04 04:45:09,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62b5586a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21a29a37}, log id: 685b6f38 >2013-12-04 04:45:15,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6a83c53a >2013-12-04 04:45:15,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a83c53a >2013-12-04 04:45:15,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 66ec3ce2 >2013-12-04 04:45:15,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f78e42e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cd3d6d4}, log id: 66ec3ce2 >2013-12-04 04:45:20,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26a3cec4 >2013-12-04 04:45:21,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 26a3cec4 >2013-12-04 04:45:21,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 608c20fc >2013-12-04 04:45:21,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1f3bb51, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de23ec36}, log id: 608c20fc >2013-12-04 04:45:26,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 173041ac >2013-12-04 04:45:27,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 173041ac >2013-12-04 04:45:27,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3654fdf >2013-12-04 04:45:27,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b53f0b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b15523bc}, log id: 3654fdf >2013-12-04 04:45:32,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58911bf6 >2013-12-04 04:45:32,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 58911bf6 >2013-12-04 04:45:32,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 72cc02f2 >2013-12-04 04:45:33,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@877d9eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b9ef5ad}, log id: 72cc02f2 >2013-12-04 04:45:38,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 33f6646e >2013-12-04 04:45:38,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 33f6646e >2013-12-04 04:45:38,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5cef9d41 >2013-12-04 04:45:39,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0673a5c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e7e941e}, log id: 5cef9d41 >2013-12-04 04:45:44,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f2f5c81 >2013-12-04 04:45:44,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7f2f5c81 >2013-12-04 04:45:44,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 781e3a96 >2013-12-04 04:45:44,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96bcad5f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b124d09e}, log id: 781e3a96 >2013-12-04 04:45:49,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a94134d >2013-12-04 04:45:50,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a94134d >2013-12-04 04:45:50,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 74f10934 >2013-12-04 04:45:50,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d910f6d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80473c4c}, log id: 74f10934 >2013-12-04 04:45:55,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e581f19 >2013-12-04 04:45:56,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e581f19 >2013-12-04 04:45:56,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5914038f >2013-12-04 04:45:56,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f5d6158, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8336cb}, log id: 5914038f >2013-12-04 04:46:01,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3752f215 >2013-12-04 04:46:02,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3752f215 >2013-12-04 04:46:02,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7183e0a8 >2013-12-04 04:46:02,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bef59146, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c607557a}, log id: 7183e0a8 >2013-12-04 04:46:07,090 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-04 04:46:07,091 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:46:07,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 83da4f2 >2013-12-04 04:46:07,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 570c24d2 >2013-12-04 04:46:07,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 83da4f2 >2013-12-04 04:46:07,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 570c24d2 >2013-12-04 04:46:07,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 8c97c8c >2013-12-04 04:46:08,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e951ae4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bd28580}, log id: 8c97c8c >2013-12-04 04:46:13,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5688bb5e >2013-12-04 04:46:13,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5688bb5e >2013-12-04 04:46:13,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 463805d0 >2013-12-04 04:46:13,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@265b50f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c716f39}, log id: 463805d0 >2013-12-04 04:46:18,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2b1f0d2f >2013-12-04 04:46:19,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b1f0d2f >2013-12-04 04:46:19,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 13857a4a >2013-12-04 04:46:19,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afcae05e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be14d1fb}, log id: 13857a4a >2013-12-04 04:46:24,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3f8a061 >2013-12-04 04:46:25,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f8a061 >2013-12-04 04:46:25,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5ec00881 >2013-12-04 04:46:25,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0462f65, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c97dd74}, log id: 5ec00881 >2013-12-04 04:46:30,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 64c09092 >2013-12-04 04:46:31,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 64c09092 >2013-12-04 04:46:31,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67f17fcf >2013-12-04 04:46:31,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9e33180, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@134ac770}, log id: 67f17fcf >2013-12-04 04:46:36,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3c9ad984 >2013-12-04 04:46:36,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c9ad984 >2013-12-04 04:46:36,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 42bb6004 >2013-12-04 04:46:37,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f33ed38, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8b12b1f}, log id: 42bb6004 >2013-12-04 04:46:42,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 659a7ca7 >2013-12-04 04:46:42,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 659a7ca7 >2013-12-04 04:46:42,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 63feb85f >2013-12-04 04:46:43,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7765b53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@738df7e5}, log id: 63feb85f >2013-12-04 04:46:48,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 76f277f6 >2013-12-04 04:46:48,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 76f277f6 >2013-12-04 04:46:48,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79674771 >2013-12-04 04:46:48,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95fb33c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98898214}, log id: 79674771 >2013-12-04 04:46:53,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 218058ca >2013-12-04 04:46:54,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 218058ca >2013-12-04 04:46:54,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 29b7ff68 >2013-12-04 04:46:54,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55f8a77, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@149c4499}, log id: 29b7ff68 >2013-12-04 04:46:59,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1cd2e5ff >2013-12-04 04:47:00,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cd2e5ff >2013-12-04 04:47:00,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ad266af >2013-12-04 04:47:00,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30e58fa1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77b7523c}, log id: 6ad266af >2013-12-04 04:47:05,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48cc889a >2013-12-04 04:47:06,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 48cc889a >2013-12-04 04:47:06,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 333675bc >2013-12-04 04:47:06,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1599504, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64bc8af1}, log id: 333675bc >2013-12-04 04:47:07,408 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) No up server in cluster >2013-12-04 04:47:07,408 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:47:07,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2a8152fa >2013-12-04 04:47:07,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2a8152fa >2013-12-04 04:47:11,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 169d3212 >2013-12-04 04:47:11,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 169d3212 >2013-12-04 04:47:11,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 71c2ebde >2013-12-04 04:47:12,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84e3766f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7df25559}, log id: 71c2ebde >2013-12-04 04:47:17,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2339abd9 >2013-12-04 04:47:17,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2339abd9 >2013-12-04 04:47:17,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 62bdf5da >2013-12-04 04:47:17,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77e11230, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5064860a}, log id: 62bdf5da >2013-12-04 04:47:22,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4510e9f1 >2013-12-04 04:47:23,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4510e9f1 >2013-12-04 04:47:23,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4c8e5107 >2013-12-04 04:47:23,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc694c26, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d9b8043}, log id: 4c8e5107 >2013-12-04 04:47:28,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ca200e4 >2013-12-04 04:47:29,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3ca200e4 >2013-12-04 04:47:29,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 30126dc0 >2013-12-04 04:47:29,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@879d1e49, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c73b78c}, log id: 30126dc0 >2013-12-04 04:47:34,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 117732de >2013-12-04 04:47:35,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 117732de >2013-12-04 04:47:35,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30538611 >2013-12-04 04:47:35,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@591f7914, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16580811}, log id: 30538611 >2013-12-04 04:47:40,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 50901b42 >2013-12-04 04:47:40,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 50901b42 >2013-12-04 04:47:40,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1fac9786 >2013-12-04 04:47:41,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7859a748, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0bb554d}, log id: 1fac9786 >2013-12-04 04:47:46,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 75b0013b >2013-12-04 04:47:46,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75b0013b >2013-12-04 04:47:46,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 456da884 >2013-12-04 04:47:46,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d5b0aac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a1427b2}, log id: 456da884 >2013-12-04 04:47:52,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 85f3e24 >2013-12-04 04:47:52,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 85f3e24 >2013-12-04 04:47:52,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 225df7fe >2013-12-04 04:47:52,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2be7e035, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@563aa1d9}, log id: 225df7fe >2013-12-04 04:47:57,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b14ff8a >2013-12-04 04:47:58,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b14ff8a >2013-12-04 04:47:58,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 401cfaa9 >2013-12-04 04:47:58,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23b0a762, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@956acc9}, log id: 401cfaa9 >2013-12-04 04:48:03,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6576cd6f >2013-12-04 04:48:04,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6576cd6f >2013-12-04 04:48:04,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1dea462f >2013-12-04 04:48:04,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2f2e2e3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffb17e34}, log id: 1dea462f >2013-12-04 04:48:07,718 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-04 04:48:07,718 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:48:07,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ec409ab >2013-12-04 04:48:08,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3ec409ab >2013-12-04 04:48:09,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 52a8d77b >2013-12-04 04:48:10,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 52a8d77b >2013-12-04 04:48:10,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b17d509 >2013-12-04 04:48:10,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@662510d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b5ec788}, log id: 5b17d509 >2013-12-04 04:48:15,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 21c65fe9 >2013-12-04 04:48:15,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21c65fe9 >2013-12-04 04:48:15,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1300813e >2013-12-04 04:48:16,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27cdd8cc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92ec1b32}, log id: 1300813e >2013-12-04 04:48:21,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ef0f21e >2013-12-04 04:48:21,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ef0f21e >2013-12-04 04:48:21,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4933b5ac >2013-12-04 04:48:22,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dda9dc9d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7166d2af}, log id: 4933b5ac >2013-12-04 04:48:27,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ef24b00 >2013-12-04 04:48:27,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ef24b00 >2013-12-04 04:48:27,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3773dd2c >2013-12-04 04:48:27,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9f82132, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b31a0969}, log id: 3773dd2c >2013-12-04 04:48:32,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a543cd5 >2013-12-04 04:48:33,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7a543cd5 >2013-12-04 04:48:33,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 174ff239 >2013-12-04 04:48:33,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec9f53a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50cf569e}, log id: 174ff239 >2013-12-04 04:48:38,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29150b90 >2013-12-04 04:48:39,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 29150b90 >2013-12-04 04:48:39,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46899c15 >2013-12-04 04:48:39,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e4019be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa9b31a3}, log id: 46899c15 >2013-12-04 04:48:44,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3a97f9b9 >2013-12-04 04:48:45,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a97f9b9 >2013-12-04 04:48:45,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5c1424ac >2013-12-04 04:48:45,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b042a637, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cea42d3}, log id: 5c1424ac >2013-12-04 04:48:50,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 513aee67 >2013-12-04 04:48:50,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 513aee67 >2013-12-04 04:48:50,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 34d67db9 >2013-12-04 04:48:51,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19a002c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@200e523e}, log id: 34d67db9 >2013-12-04 04:48:54,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 26155844 >2013-12-04 04:48:55,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@58327edc, log id: 26155844 >2013-12-04 04:48:55,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5b26cac0 >2013-12-04 04:48:55,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@47f1126e, log id: 5b26cac0 >2013-12-04 04:48:56,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1459805c >2013-12-04 04:48:56,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1459805c >2013-12-04 04:48:56,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4021049a >2013-12-04 04:48:56,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2670263, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24d8edf7}, log id: 4021049a >2013-12-04 04:49:01,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 27d64315 >2013-12-04 04:49:02,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27d64315 >2013-12-04 04:49:02,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 192bb596 >2013-12-04 04:49:02,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@419a54f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9d3425}, log id: 192bb596 >2013-12-04 04:49:07,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: e17fbac >2013-12-04 04:49:08,040 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-04 04:49:08,040 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:49:08,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 36d1282a >2013-12-04 04:49:08,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: e17fbac >2013-12-04 04:49:08,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7b964dfd >2013-12-04 04:49:08,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 36d1282a >2013-12-04 04:49:08,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e61c17, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eec5a1b0}, log id: 7b964dfd >2013-12-04 04:49:13,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 57a8c226 >2013-12-04 04:49:14,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57a8c226 >2013-12-04 04:49:14,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 17fa0c9c >2013-12-04 04:49:14,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d52926c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@109488b1}, log id: 17fa0c9c >2013-12-04 04:49:19,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 61da1f9b >2013-12-04 04:49:19,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61da1f9b >2013-12-04 04:49:19,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 38c6b9e8 >2013-12-04 04:49:20,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17a575d0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52f431fb}, log id: 38c6b9e8 >2013-12-04 04:49:25,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3e5bc77e >2013-12-04 04:49:25,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e5bc77e >2013-12-04 04:49:25,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3e0f715a >2013-12-04 04:49:25,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@680c01fe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8038c77}, log id: 3e0f715a >2013-12-04 04:49:31,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 283b9a37 >2013-12-04 04:49:31,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 283b9a37 >2013-12-04 04:49:31,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 289ac53 >2013-12-04 04:49:31,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3a9a2f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24c51fc4}, log id: 289ac53 >2013-12-04 04:49:36,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3175ff62 >2013-12-04 04:49:37,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3175ff62 >2013-12-04 04:49:37,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c35195b >2013-12-04 04:49:37,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6543fc82, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcfdd561}, log id: 1c35195b >2013-12-04 04:49:42,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20898ba6 >2013-12-04 04:49:43,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 20898ba6 >2013-12-04 04:49:43,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4eb9e076 >2013-12-04 04:49:43,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0f77ecb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@503bde2c}, log id: 4eb9e076 >2013-12-04 04:49:48,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22df5518 >2013-12-04 04:49:48,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 22df5518 >2013-12-04 04:49:48,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 92a9002 >2013-12-04 04:49:49,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2302ca7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf30807}, log id: 92a9002 >2013-12-04 04:49:54,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 552cd64a >2013-12-04 04:49:54,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 552cd64a >2013-12-04 04:49:54,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 678201ac >2013-12-04 04:49:55,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba3fd423, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64776868}, log id: 678201ac >2013-12-04 04:50:00,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a497276 >2013-12-04 04:50:00,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4a497276 >2013-12-04 04:50:00,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c21cc4f >2013-12-04 04:50:00,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81e003cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1999140}, log id: 5c21cc4f >2013-12-04 04:50:05,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 20db68b9 >2013-12-04 04:50:06,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20db68b9 >2013-12-04 04:50:06,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4a8e5c90 >2013-12-04 04:50:06,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f93208b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58ee5f4e}, log id: 4a8e5c90 >2013-12-04 04:50:08,328 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-04 04:50:08,329 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:50:08,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 788f5c66 >2013-12-04 04:50:08,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 788f5c66 >2013-12-04 04:50:11,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2eff8906 >2013-12-04 04:50:12,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2eff8906 >2013-12-04 04:50:12,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c34eb74 >2013-12-04 04:50:12,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@469aebb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9953d3c}, log id: 5c34eb74 >2013-12-04 04:50:17,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f2d53ed >2013-12-04 04:50:18,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f2d53ed >2013-12-04 04:50:18,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 35d4da4d >2013-12-04 04:50:18,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8efe166, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@131bcc46}, log id: 35d4da4d >2013-12-04 04:50:23,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59ded928 >2013-12-04 04:50:23,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 59ded928 >2013-12-04 04:50:23,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 666af4df >2013-12-04 04:50:24,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37f3b26c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c00ae01a}, log id: 666af4df >2013-12-04 04:50:29,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1819b993 >2013-12-04 04:50:29,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1819b993 >2013-12-04 04:50:29,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 710635d0 >2013-12-04 04:50:30,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58fd2746, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bb459c2}, log id: 710635d0 >2013-12-04 04:50:35,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 735ca00d >2013-12-04 04:50:35,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 735ca00d >2013-12-04 04:50:35,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4622510 >2013-12-04 04:50:35,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e462bd4e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7df3b0af}, log id: 4622510 >2013-12-04 04:50:40,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11450dd9 >2013-12-04 04:50:41,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 11450dd9 >2013-12-04 04:50:41,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1288bf8e >2013-12-04 04:50:41,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99be96a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a644496}, log id: 1288bf8e >2013-12-04 04:50:46,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: f5e5071 >2013-12-04 04:50:47,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f5e5071 >2013-12-04 04:50:47,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 571ae65e >2013-12-04 04:50:47,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1a2c423, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1eb0ace2}, log id: 571ae65e >2013-12-04 04:50:52,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6fbcb31c >2013-12-04 04:50:52,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fbcb31c >2013-12-04 04:50:52,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76335a4f >2013-12-04 04:50:53,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35a753e4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77ee891b}, log id: 76335a4f >2013-12-04 04:50:58,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 31ec0014 >2013-12-04 04:50:58,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 31ec0014 >2013-12-04 04:50:58,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5be3f8fa >2013-12-04 04:50:59,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1dd0662d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a15fadf}, log id: 5be3f8fa >2013-12-04 04:51:04,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a808703 >2013-12-04 04:51:04,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a808703 >2013-12-04 04:51:04,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: fe30ce3 >2013-12-04 04:51:04,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96776fde, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf68c721}, log id: fe30ce3 >2013-12-04 04:51:08,640 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-7) No up server in cluster >2013-12-04 04:51:08,640 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-7) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:51:08,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38e951ed >2013-12-04 04:51:08,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, return: [], log id: 38e951ed >2013-12-04 04:51:09,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3e0028f6 >2013-12-04 04:51:10,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e0028f6 >2013-12-04 04:51:10,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1149261a >2013-12-04 04:51:10,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d09106d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50ba2d37}, log id: 1149261a >2013-12-04 04:51:15,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75a43aa1 >2013-12-04 04:51:16,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 75a43aa1 >2013-12-04 04:51:16,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66d0dd36 >2013-12-04 04:51:16,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99480e79, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80bf0105}, log id: 66d0dd36 >2013-12-04 04:51:21,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 332f9165 >2013-12-04 04:51:22,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 332f9165 >2013-12-04 04:51:22,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e80fa3c >2013-12-04 04:51:22,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8446578f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dff307d}, log id: 2e80fa3c >2013-12-04 04:51:27,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 723f8c09 >2013-12-04 04:51:27,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 723f8c09 >2013-12-04 04:51:27,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c3bca2d >2013-12-04 04:51:28,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1a398ae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2240223f}, log id: 1c3bca2d >2013-12-04 04:51:33,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b004b31 >2013-12-04 04:51:33,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3b004b31 >2013-12-04 04:51:33,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 13c4b83e >2013-12-04 04:51:34,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f67bbd21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a6b4e0f}, log id: 13c4b83e >2013-12-04 04:51:39,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1450f784 >2013-12-04 04:51:39,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1450f784 >2013-12-04 04:51:39,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 19546674 >2013-12-04 04:51:39,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8746bef3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59321442}, log id: 19546674 >2013-12-04 04:51:44,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19283945 >2013-12-04 04:51:45,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 19283945 >2013-12-04 04:51:45,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b5e28d1 >2013-12-04 04:51:45,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ee6c12f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@420e78ae}, log id: 1b5e28d1 >2013-12-04 04:51:50,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29d5cbf2 >2013-12-04 04:51:51,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 29d5cbf2 >2013-12-04 04:51:51,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 26021457 >2013-12-04 04:51:51,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@574ed82c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16249125}, log id: 26021457 >2013-12-04 04:51:56,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 279eb4f8 >2013-12-04 04:51:57,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 279eb4f8 >2013-12-04 04:51:57,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 58e4bfc8 >2013-12-04 04:51:57,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38efd51b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4532ca85}, log id: 58e4bfc8 >2013-12-04 04:52:02,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 49a2d379 >2013-12-04 04:52:02,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 49a2d379 >2013-12-04 04:52:02,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 62caa944 >2013-12-04 04:52:03,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@922e5a51, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3c5133a}, log id: 62caa944 >2013-12-04 04:52:08,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 89bd6ab >2013-12-04 04:52:08,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 89bd6ab >2013-12-04 04:52:08,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ec68257 >2013-12-04 04:52:08,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfb09a30, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@639e2108}, log id: 2ec68257 >2013-12-04 04:52:08,937 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-04 04:52:08,937 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:52:08,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45d0c733 >2013-12-04 04:52:09,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 45d0c733 >2013-12-04 04:52:13,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f8a3719 >2013-12-04 04:52:14,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f8a3719 >2013-12-04 04:52:14,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70c33b4a >2013-12-04 04:52:14,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df792860, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af97c05f}, log id: 70c33b4a >2013-12-04 04:52:19,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 750c7982 >2013-12-04 04:52:20,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 750c7982 >2013-12-04 04:52:20,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 22858523 >2013-12-04 04:52:20,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca88797a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13601bf2}, log id: 22858523 >2013-12-04 04:52:25,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 51353c58 >2013-12-04 04:52:26,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51353c58 >2013-12-04 04:52:26,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 701c22a7 >2013-12-04 04:52:26,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41468627, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf880957}, log id: 701c22a7 >2013-12-04 04:52:31,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 304bf87e >2013-12-04 04:52:31,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 304bf87e >2013-12-04 04:52:31,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c0a83c9 >2013-12-04 04:52:32,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef9e31b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d84a1530}, log id: 2c0a83c9 >2013-12-04 04:52:37,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 46d45b4f >2013-12-04 04:52:37,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 46d45b4f >2013-12-04 04:52:37,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f8a5038 >2013-12-04 04:52:37,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dae183c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18cf7200}, log id: 4f8a5038 >2013-12-04 04:52:42,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ee33d3e >2013-12-04 04:52:43,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1ee33d3e >2013-12-04 04:52:43,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f8d2f45 >2013-12-04 04:52:43,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56220135, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ec3f1c8}, log id: 6f8d2f45 >2013-12-04 04:52:48,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4026a3fc >2013-12-04 04:52:49,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4026a3fc >2013-12-04 04:52:49,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ad059b9 >2013-12-04 04:52:49,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@495916db, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@103ed6ea}, log id: 3ad059b9 >2013-12-04 04:52:54,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 19ba7685 >2013-12-04 04:52:55,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19ba7685 >2013-12-04 04:52:55,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 76f0c317 >2013-12-04 04:52:55,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5357eb24, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19c24759}, log id: 76f0c317 >2013-12-04 04:53:00,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7271a562 >2013-12-04 04:53:01,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7271a562 >2013-12-04 04:53:01,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4da7c6a8 >2013-12-04 04:53:01,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc7d11ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64fe44db}, log id: 4da7c6a8 >2013-12-04 04:53:06,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b011f71 >2013-12-04 04:53:06,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2b011f71 >2013-12-04 04:53:06,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d5ec03f >2013-12-04 04:53:07,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7abfda1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5aada89d}, log id: 3d5ec03f >2013-12-04 04:53:09,252 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-04 04:53:09,252 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:53:09,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b35f05a >2013-12-04 04:53:09,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1b35f05a >2013-12-04 04:53:12,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 15fd2b6f >2013-12-04 04:53:12,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15fd2b6f >2013-12-04 04:53:12,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1ec4a17e >2013-12-04 04:53:12,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a2f910d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dcae39}, log id: 1ec4a17e >2013-12-04 04:53:17,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5082ee28 >2013-12-04 04:53:18,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5082ee28 >2013-12-04 04:53:18,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 351350f7 >2013-12-04 04:53:18,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fd3afd8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@401f5cbf}, log id: 351350f7 >2013-12-04 04:53:23,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2e325802 >2013-12-04 04:53:24,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e325802 >2013-12-04 04:53:24,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 67cff278 >2013-12-04 04:53:24,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1e06da8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de2de6b3}, log id: 67cff278 >2013-12-04 04:53:29,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 234f9368 >2013-12-04 04:53:30,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 234f9368 >2013-12-04 04:53:30,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6c1f5d95 >2013-12-04 04:53:30,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf96c92b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c629905}, log id: 6c1f5d95 >2013-12-04 04:53:35,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d12cd92 >2013-12-04 04:53:35,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3d12cd92 >2013-12-04 04:53:35,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 64cd22eb >2013-12-04 04:53:36,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd96f1f3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7f18165}, log id: 64cd22eb >2013-12-04 04:53:41,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54d04f2c >2013-12-04 04:53:41,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 54d04f2c >2013-12-04 04:53:41,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 35770458 >2013-12-04 04:53:41,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37315dd2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e8a40cd}, log id: 35770458 >2013-12-04 04:53:46,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2ff2e3d1 >2013-12-04 04:53:47,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2ff2e3d1 >2013-12-04 04:53:47,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5e2249af >2013-12-04 04:53:47,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bcbc028, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ad0a638}, log id: 5e2249af >2013-12-04 04:53:52,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d0a2bc1 >2013-12-04 04:53:53,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d0a2bc1 >2013-12-04 04:53:53,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5cc6d83e >2013-12-04 04:53:53,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cac72cb8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64dea2a1}, log id: 5cc6d83e >2013-12-04 04:53:55,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 172d2579 >2013-12-04 04:53:55,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6ba2e570, log id: 172d2579 >2013-12-04 04:53:55,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 13855345 >2013-12-04 04:53:55,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3685ff1, log id: 13855345 >2013-12-04 04:53:58,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7ae335c6 >2013-12-04 04:53:59,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ae335c6 >2013-12-04 04:53:59,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4710689a >2013-12-04 04:53:59,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89f3625c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6360c53}, log id: 4710689a >2013-12-04 04:54:04,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 52b7b609 >2013-12-04 04:54:04,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 52b7b609 >2013-12-04 04:54:04,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b56c90 >2013-12-04 04:54:05,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b684662, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac1b9583}, log id: 2b56c90 >2013-12-04 04:54:09,550 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-04 04:54:09,550 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:54:09,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3432be5a >2013-12-04 04:54:09,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3432be5a >2013-12-04 04:54:10,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20089d8 >2013-12-04 04:54:10,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 20089d8 >2013-12-04 04:54:10,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 33317fdf >2013-12-04 04:54:11,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fc323e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1dbc0855}, log id: 33317fdf >2013-12-04 04:54:16,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 59b05c8f >2013-12-04 04:54:16,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59b05c8f >2013-12-04 04:54:16,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6c3dfcf8 >2013-12-04 04:54:16,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b392b8c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afaab3e0}, log id: 6c3dfcf8 >2013-12-04 04:54:21,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20be69a6 >2013-12-04 04:54:22,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 20be69a6 >2013-12-04 04:54:22,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 490b4dcc >2013-12-04 04:54:22,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e34e7692, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8bb9e2f}, log id: 490b4dcc >2013-12-04 04:54:27,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10c0a753 >2013-12-04 04:54:28,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 10c0a753 >2013-12-04 04:54:28,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2406d73a >2013-12-04 04:54:28,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92b3c74, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fecbd263}, log id: 2406d73a >2013-12-04 04:54:33,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a558a99 >2013-12-04 04:54:34,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a558a99 >2013-12-04 04:54:34,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53172efb >2013-12-04 04:54:34,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f401bd53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5ccecc2}, log id: 53172efb >2013-12-04 04:54:39,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20e688ee >2013-12-04 04:54:39,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 20e688ee >2013-12-04 04:54:39,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 33833dee >2013-12-04 04:54:40,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e18b5f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff558575}, log id: 33833dee >2013-12-04 04:54:45,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 42ffbbb2 >2013-12-04 04:54:45,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 42ffbbb2 >2013-12-04 04:54:45,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43533f85 >2013-12-04 04:54:45,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8faec09c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b966814b}, log id: 43533f85 >2013-12-04 04:54:51,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a74a3b0 >2013-12-04 04:54:51,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a74a3b0 >2013-12-04 04:54:51,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e6852d >2013-12-04 04:54:51,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac44225d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dddb2a4e}, log id: 7e6852d >2013-12-04 04:54:56,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 45cdc29 >2013-12-04 04:54:57,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45cdc29 >2013-12-04 04:54:57,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 268c6310 >2013-12-04 04:54:57,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@543b4023, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1901e93d}, log id: 268c6310 >2013-12-04 04:55:02,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 76356b16 >2013-12-04 04:55:03,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76356b16 >2013-12-04 04:55:03,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 47857134 >2013-12-04 04:55:03,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7652ae5d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42aec1d1}, log id: 47857134 >2013-12-04 04:55:08,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5b348cb5 >2013-12-04 04:55:08,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b348cb5 >2013-12-04 04:55:08,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1a0d8f16 >2013-12-04 04:55:09,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e7d5eff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7504f2e3}, log id: 1a0d8f16 >2013-12-04 04:55:09,865 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) No up server in cluster >2013-12-04 04:55:09,865 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:55:09,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 573598ca >2013-12-04 04:55:10,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterTasksListVDSCommand, return: [], log id: 573598ca >2013-12-04 04:55:14,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e3bd3cc >2013-12-04 04:55:14,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3e3bd3cc >2013-12-04 04:55:14,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6e707d77 >2013-12-04 04:55:15,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43c2333f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77ec0331}, log id: 6e707d77 >2013-12-04 04:55:20,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 540a80c3 >2013-12-04 04:55:20,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 540a80c3 >2013-12-04 04:55:20,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 54f519d8 >2013-12-04 04:55:20,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4dc1320d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3ad4656}, log id: 54f519d8 >2013-12-04 04:55:25,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 464bdf3 >2013-12-04 04:55:26,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 464bdf3 >2013-12-04 04:55:26,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29830a86 >2013-12-04 04:55:26,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4def89e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a34c1c93}, log id: 29830a86 >2013-12-04 04:55:31,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 618cbbb8 >2013-12-04 04:55:32,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 618cbbb8 >2013-12-04 04:55:32,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 11a944c7 >2013-12-04 04:55:32,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59a1997d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee1099c6}, log id: 11a944c7 >2013-12-04 04:55:37,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4cebee6e >2013-12-04 04:55:38,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4cebee6e >2013-12-04 04:55:38,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4b5ebc87 >2013-12-04 04:55:38,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86094bf9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93c35558}, log id: 4b5ebc87 >2013-12-04 04:55:43,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6041181e >2013-12-04 04:55:43,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6041181e >2013-12-04 04:55:43,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63d05218 >2013-12-04 04:55:44,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a528045, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b8b783c}, log id: 63d05218 >2013-12-04 04:55:49,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 171e9694 >2013-12-04 04:55:49,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 171e9694 >2013-12-04 04:55:49,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5188b6ea >2013-12-04 04:55:49,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66c2c246, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f666600c}, log id: 5188b6ea >2013-12-04 04:55:55,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37ec264 >2013-12-04 04:55:55,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 37ec264 >2013-12-04 04:55:55,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16c7f057 >2013-12-04 04:55:55,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@704a7627, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ba67453}, log id: 16c7f057 >2013-12-04 04:56:00,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74994547 >2013-12-04 04:56:01,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 74994547 >2013-12-04 04:56:01,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3bca2551 >2013-12-04 04:56:01,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17682837, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de3b704a}, log id: 3bca2551 >2013-12-04 04:56:06,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d445f46 >2013-12-04 04:56:07,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4d445f46 >2013-12-04 04:56:07,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: fec0545 >2013-12-04 04:56:07,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9c5d435, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77c7b06c}, log id: fec0545 >2013-12-04 04:56:10,165 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-38) No up server in cluster >2013-12-04 04:56:10,165 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-38) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:56:10,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 35a2fe98 >2013-12-04 04:56:10,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterTasksListVDSCommand, return: [], log id: 35a2fe98 >2013-12-04 04:56:12,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45c0d8e1 >2013-12-04 04:56:12,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 45c0d8e1 >2013-12-04 04:56:12,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5739042c >2013-12-04 04:56:13,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe84ad12, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b72d186d}, log id: 5739042c >2013-12-04 04:56:18,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b129c8a >2013-12-04 04:56:18,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b129c8a >2013-12-04 04:56:18,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 593d8b8d >2013-12-04 04:56:19,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a37a574, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0e5135d}, log id: 593d8b8d >2013-12-04 04:56:24,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6fadda2a >2013-12-04 04:56:24,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fadda2a >2013-12-04 04:56:24,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 13049243 >2013-12-04 04:56:24,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0d88a58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91a722d9}, log id: 13049243 >2013-12-04 04:56:29,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 65209c20 >2013-12-04 04:56:30,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65209c20 >2013-12-04 04:56:30,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5ddceaa1 >2013-12-04 04:56:30,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ed97e17, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cb966db}, log id: 5ddceaa1 >2013-12-04 04:56:35,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6be8783e >2013-12-04 04:56:36,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6be8783e >2013-12-04 04:56:36,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b44c0e6 >2013-12-04 04:56:36,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ebfd169, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@482b7f18}, log id: 4b44c0e6 >2013-12-04 04:56:41,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 489eb4b1 >2013-12-04 04:56:42,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 489eb4b1 >2013-12-04 04:56:42,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12a2c8f0 >2013-12-04 04:56:42,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9648339a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f375c862}, log id: 12a2c8f0 >2013-12-04 04:56:47,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6bb80549 >2013-12-04 04:56:47,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bb80549 >2013-12-04 04:56:47,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6653ee64 >2013-12-04 04:56:48,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6d6bb62, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36cbaf5b}, log id: 6653ee64 >2013-12-04 04:56:53,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5571fa00 >2013-12-04 04:56:53,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5571fa00 >2013-12-04 04:56:53,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 977f09 >2013-12-04 04:56:54,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6c7f93e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6077b4}, log id: 977f09 >2013-12-04 04:56:59,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5273ff9e >2013-12-04 04:56:59,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5273ff9e >2013-12-04 04:56:59,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 12a451bd >2013-12-04 04:56:59,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fc8db1e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b224e75}, log id: 12a451bd >2013-12-04 04:57:04,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 785e5ce9 >2013-12-04 04:57:05,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 785e5ce9 >2013-12-04 04:57:05,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ee1bd55 >2013-12-04 04:57:05,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@519d3641, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7022dfa4}, log id: 3ee1bd55 >2013-12-04 04:57:10,467 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-04 04:57:10,467 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:57:10,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7904c781 >2013-12-04 04:57:10,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7164035a >2013-12-04 04:57:10,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7904c781 >2013-12-04 04:57:11,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7164035a >2013-12-04 04:57:11,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3cdab32 >2013-12-04 04:57:11,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cc3b9fe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9315c54}, log id: 3cdab32 >2013-12-04 04:57:16,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3823c1ca >2013-12-04 04:57:17,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3823c1ca >2013-12-04 04:57:17,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5819fbaf >2013-12-04 04:57:17,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9f07966, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16fcf106}, log id: 5819fbaf >2013-12-04 04:57:22,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d3cc420 >2013-12-04 04:57:22,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d3cc420 >2013-12-04 04:57:22,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c25e79d >2013-12-04 04:57:23,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30064393, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e83735}, log id: 3c25e79d >2013-12-04 04:57:28,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73887a8e >2013-12-04 04:57:28,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 73887a8e >2013-12-04 04:57:28,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3636467c >2013-12-04 04:57:28,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@642a2bde, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81659929}, log id: 3636467c >2013-12-04 04:57:33,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a0e6184 >2013-12-04 04:57:34,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a0e6184 >2013-12-04 04:57:34,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61a0129e >2013-12-04 04:57:34,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73a61ab3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3613fc14}, log id: 61a0129e >2013-12-04 04:57:39,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36782973 >2013-12-04 04:57:40,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36782973 >2013-12-04 04:57:40,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9ccf1f2 >2013-12-04 04:57:40,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37dc6a00, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8889fc01}, log id: 9ccf1f2 >2013-12-04 04:57:45,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 694c235f >2013-12-04 04:57:46,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 694c235f >2013-12-04 04:57:46,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 497aecfd >2013-12-04 04:57:46,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a665fae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4649b941}, log id: 497aecfd >2013-12-04 04:57:51,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 267c9dd1 >2013-12-04 04:57:51,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 267c9dd1 >2013-12-04 04:57:51,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 38924a9c >2013-12-04 04:57:52,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af1c0bb3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dd51d2a}, log id: 38924a9c >2013-12-04 04:57:57,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5fb3dddd >2013-12-04 04:57:57,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5fb3dddd >2013-12-04 04:57:57,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 571235e1 >2013-12-04 04:57:58,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d79f9a3b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d4bc766}, log id: 571235e1 >2013-12-04 04:58:03,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 163e9a18 >2013-12-04 04:58:03,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 163e9a18 >2013-12-04 04:58:03,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 427e1075 >2013-12-04 04:58:03,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38a8cb3d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f49cd2ca}, log id: 427e1075 >2013-12-04 04:58:08,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 15616a45 >2013-12-04 04:58:09,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 15616a45 >2013-12-04 04:58:09,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 67f2968a >2013-12-04 04:58:09,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96b1f1ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f34ee9b}, log id: 67f2968a >2013-12-04 04:58:10,773 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) No up server in cluster >2013-12-04 04:58:10,774 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:58:10,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5ce8fa4b >2013-12-04 04:58:11,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5ce8fa4b >2013-12-04 04:58:14,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ef56307 >2013-12-04 04:58:15,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ef56307 >2013-12-04 04:58:15,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32ef9243 >2013-12-04 04:58:15,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2937099e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cb69155}, log id: 32ef9243 >2013-12-04 04:58:20,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5078ee44 >2013-12-04 04:58:21,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5078ee44 >2013-12-04 04:58:21,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5ec64160 >2013-12-04 04:58:21,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fda4f1a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed104688}, log id: 5ec64160 >2013-12-04 04:58:26,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 202e3135 >2013-12-04 04:58:26,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 202e3135 >2013-12-04 04:58:26,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d0c0f2a >2013-12-04 04:58:27,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fae74c38, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2831f06}, log id: 2d0c0f2a >2013-12-04 04:58:32,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 758b6265 >2013-12-04 04:58:32,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 758b6265 >2013-12-04 04:58:32,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 129b5a6d >2013-12-04 04:58:33,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f897adfe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b28d0e2}, log id: 129b5a6d >2013-12-04 04:58:38,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18f6ef72 >2013-12-04 04:58:38,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 18f6ef72 >2013-12-04 04:58:38,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7af8026f >2013-12-04 04:58:38,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1474234, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10d79f11}, log id: 7af8026f >2013-12-04 04:58:43,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2b21dc6d >2013-12-04 04:58:44,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b21dc6d >2013-12-04 04:58:44,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 65e89796 >2013-12-04 04:58:44,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99453b3a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0556370}, log id: 65e89796 >2013-12-04 04:58:49,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 61f3363b >2013-12-04 04:58:50,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61f3363b >2013-12-04 04:58:50,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 722238d2 >2013-12-04 04:58:50,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e661c86, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23e1b0e7}, log id: 722238d2 >2013-12-04 04:58:55,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 588d34c >2013-12-04 04:58:55,911 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-48) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 04:58:55,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 588d34c >2013-12-04 04:58:55,995 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-48) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 04:58:55,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7bf09cc7 >2013-12-04 04:58:56,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12c198a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7644148}, log id: 7bf09cc7 >2013-12-04 04:58:56,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 60bf4995 >2013-12-04 04:58:56,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@343cbfe8, log id: 60bf4995 >2013-12-04 04:58:56,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6ebf10fa >2013-12-04 04:58:56,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7b70959a, log id: 6ebf10fa >2013-12-04 04:59:01,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a689ff0 >2013-12-04 04:59:01,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6a689ff0 >2013-12-04 04:59:01,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 43ed55dd >2013-12-04 04:59:02,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@656309d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e74290cd}, log id: 43ed55dd >2013-12-04 04:59:07,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5458ed01 >2013-12-04 04:59:07,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5458ed01 >2013-12-04 04:59:07,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37469846 >2013-12-04 04:59:07,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@563fa3a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ec1cf75}, log id: 37469846 >2013-12-04 04:59:11,086 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-04 04:59:11,086 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 04:59:11,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25b7015a >2013-12-04 04:59:11,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 25b7015a >2013-12-04 04:59:12,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4b141b0f >2013-12-04 04:59:13,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b141b0f >2013-12-04 04:59:13,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6bd0553e >2013-12-04 04:59:13,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79753b4e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8f2aec4}, log id: 6bd0553e >2013-12-04 04:59:18,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 72cc1809 >2013-12-04 04:59:19,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 72cc1809 >2013-12-04 04:59:19,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19d8b5c9 >2013-12-04 04:59:19,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fabca41, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cac7c19}, log id: 19d8b5c9 >2013-12-04 04:59:24,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35d6c4ac >2013-12-04 04:59:25,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 35d6c4ac >2013-12-04 04:59:25,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4f3f7eec >2013-12-04 04:59:25,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a60e666, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87165ffc}, log id: 4f3f7eec >2013-12-04 04:59:30,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41824aca >2013-12-04 04:59:30,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 41824aca >2013-12-04 04:59:30,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11ae0659 >2013-12-04 04:59:31,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c1392eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0c2dacb}, log id: 11ae0659 >2013-12-04 04:59:36,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2022d54d >2013-12-04 04:59:36,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2022d54d >2013-12-04 04:59:36,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5be152a7 >2013-12-04 04:59:37,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74f7e585, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8e38626}, log id: 5be152a7 >2013-12-04 04:59:42,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2c659fd2 >2013-12-04 04:59:42,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c659fd2 >2013-12-04 04:59:42,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4bd325fe >2013-12-04 04:59:42,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d229bffd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bedb8db5}, log id: 4bd325fe >2013-12-04 04:59:47,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 79edccc6 >2013-12-04 04:59:48,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 79edccc6 >2013-12-04 04:59:48,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 36b9721d >2013-12-04 04:59:48,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@575e1e40, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f4ba643}, log id: 36b9721d >2013-12-04 04:59:53,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7b2e0b40 >2013-12-04 04:59:54,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b2e0b40 >2013-12-04 04:59:54,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 20ea4f54 >2013-12-04 04:59:54,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@104a30b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acdd911}, log id: 20ea4f54 >2013-12-04 04:59:59,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4aa2dfa2 >2013-12-04 05:00:00,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4aa2dfa2 >2013-12-04 05:00:00,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b45bc0d >2013-12-04 05:00:00,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd925f01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f114c06}, log id: 2b45bc0d >2013-12-04 05:00:05,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 505c2ea9 >2013-12-04 05:00:05,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 505c2ea9 >2013-12-04 05:00:05,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79b78505 >2013-12-04 05:00:06,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42218676, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e47cbbd}, log id: 79b78505 >2013-12-04 05:00:11,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6da24dc9 >2013-12-04 05:00:11,416 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-04 05:00:11,425 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:00:11,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a69ee27 >2013-12-04 05:00:11,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1a69ee27 >2013-12-04 05:00:11,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6da24dc9 >2013-12-04 05:00:11,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 33113f54 >2013-12-04 05:00:11,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1f05fbe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2c912bc}, log id: 33113f54 >2013-12-04 05:00:17,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d289740 >2013-12-04 05:00:17,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d289740 >2013-12-04 05:00:17,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8a1b8e7 >2013-12-04 05:00:17,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a542590d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebe4cae9}, log id: 8a1b8e7 >2013-12-04 05:00:22,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 16bbeb97 >2013-12-04 05:00:23,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 16bbeb97 >2013-12-04 05:00:23,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1570d2c2 >2013-12-04 05:00:23,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a7d8aa9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4750674a}, log id: 1570d2c2 >2013-12-04 05:00:28,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6fd2a154 >2013-12-04 05:00:29,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6fd2a154 >2013-12-04 05:00:29,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 64eb2238 >2013-12-04 05:00:29,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e6996f5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbfca67e}, log id: 64eb2238 >2013-12-04 05:00:34,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5056303e >2013-12-04 05:00:34,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5056303e >2013-12-04 05:00:34,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57718bc1 >2013-12-04 05:00:35,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3a7498f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d969f32}, log id: 57718bc1 >2013-12-04 05:00:40,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 9c931e0 >2013-12-04 05:00:40,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9c931e0 >2013-12-04 05:00:40,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1cf51c9c >2013-12-04 05:00:41,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a45692d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e77a57a}, log id: 1cf51c9c >2013-12-04 05:00:46,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 62277269 >2013-12-04 05:00:46,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 62277269 >2013-12-04 05:00:46,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d9eaf6 >2013-12-04 05:00:46,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6862cf0c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2be03f60}, log id: 2d9eaf6 >2013-12-04 05:00:51,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: d3ecb8d >2013-12-04 05:00:52,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: d3ecb8d >2013-12-04 05:00:52,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 77c464d7 >2013-12-04 05:00:52,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a805237c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f2fc153}, log id: 77c464d7 >2013-12-04 05:00:57,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6c2c3254 >2013-12-04 05:00:58,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c2c3254 >2013-12-04 05:00:58,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 340bd640 >2013-12-04 05:00:58,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a86d747, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e696f2}, log id: 340bd640 >2013-12-04 05:01:03,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 658f0423 >2013-12-04 05:01:04,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 658f0423 >2013-12-04 05:01:04,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1fc53597 >2013-12-04 05:01:04,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10d486d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cf59f3f}, log id: 1fc53597 >2013-12-04 05:01:09,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 208d9aa >2013-12-04 05:01:09,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 208d9aa >2013-12-04 05:01:09,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5caff9c3 >2013-12-04 05:01:10,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52fccaeb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eece70bc}, log id: 5caff9c3 >2013-12-04 05:01:11,701 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-04 05:01:11,702 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:01:11,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 25245f91 >2013-12-04 05:01:12,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 25245f91 >2013-12-04 05:01:15,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 662692c5 >2013-12-04 05:01:15,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 662692c5 >2013-12-04 05:01:15,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ac9f338 >2013-12-04 05:01:15,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44d788fa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df83bc8f}, log id: 1ac9f338 >2013-12-04 05:01:21,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6508946f >2013-12-04 05:01:21,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6508946f >2013-12-04 05:01:21,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20390c28 >2013-12-04 05:01:21,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a71c135b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@940abae3}, log id: 20390c28 >2013-12-04 05:01:26,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 523874df >2013-12-04 05:01:27,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 523874df >2013-12-04 05:01:27,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 215ecfa5 >2013-12-04 05:01:27,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8a1c0a2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff9117c9}, log id: 215ecfa5 >2013-12-04 05:01:32,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58864718 >2013-12-04 05:01:33,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 58864718 >2013-12-04 05:01:33,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b0e813a >2013-12-04 05:01:33,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a52b1c7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9085fb83}, log id: 7b0e813a >2013-12-04 05:01:38,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 60dc4bb5 >2013-12-04 05:01:38,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 60dc4bb5 >2013-12-04 05:01:38,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17bb1661 >2013-12-04 05:01:39,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb9b4809, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cf555c6}, log id: 17bb1661 >2013-12-04 05:01:44,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f281a33 >2013-12-04 05:01:44,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: f281a33 >2013-12-04 05:01:44,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 557baa2e >2013-12-04 05:01:45,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ee81153, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60f777da}, log id: 557baa2e >2013-12-04 05:01:50,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 13a8a27a >2013-12-04 05:01:50,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 13a8a27a >2013-12-04 05:01:50,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 77f64137 >2013-12-04 05:01:50,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be6ddce9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5e10f27}, log id: 77f64137 >2013-12-04 05:01:55,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 136563a8 >2013-12-04 05:01:56,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 136563a8 >2013-12-04 05:01:56,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 24edcb89 >2013-12-04 05:01:56,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63c03c4b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc372f3}, log id: 24edcb89 >2013-12-04 05:02:01,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d0ba01c >2013-12-04 05:02:02,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2d0ba01c >2013-12-04 05:02:02,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 864f78b >2013-12-04 05:02:02,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afb129be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b143e4c2}, log id: 864f78b >2013-12-04 05:02:07,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e712508 >2013-12-04 05:02:08,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e712508 >2013-12-04 05:02:08,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d1eb5ad >2013-12-04 05:02:08,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d02e8791, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc2625f}, log id: 4d1eb5ad >2013-12-04 05:02:12,008 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-43) No up server in cluster >2013-12-04 05:02:12,009 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-43) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:02:12,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11ace25d >2013-12-04 05:02:12,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterTasksListVDSCommand, return: [], log id: 11ace25d >2013-12-04 05:02:13,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3b66556f >2013-12-04 05:02:13,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b66556f >2013-12-04 05:02:13,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 65301296 >2013-12-04 05:02:14,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ed8aca2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a4f3564}, log id: 65301296 >2013-12-04 05:02:19,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 680a7dfd >2013-12-04 05:02:19,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 680a7dfd >2013-12-04 05:02:19,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 231a5fd1 >2013-12-04 05:02:19,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@269450ca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9be0b8f9}, log id: 231a5fd1 >2013-12-04 05:02:24,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3d342b97 >2013-12-04 05:02:25,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d342b97 >2013-12-04 05:02:25,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6a50385e >2013-12-04 05:02:25,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31f1e9d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2772131}, log id: 6a50385e >2013-12-04 05:02:30,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 727380ad >2013-12-04 05:02:31,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 727380ad >2013-12-04 05:02:31,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a9f6c63 >2013-12-04 05:02:31,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4be6e228, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed7eae28}, log id: 5a9f6c63 >2013-12-04 05:02:36,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 419c8ee1 >2013-12-04 05:02:37,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 419c8ee1 >2013-12-04 05:02:37,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1dd1ef1f >2013-12-04 05:02:37,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49579910, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62aa0a20}, log id: 1dd1ef1f >2013-12-04 05:02:42,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2f50d4f3 >2013-12-04 05:02:42,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f50d4f3 >2013-12-04 05:02:42,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: aa6c1db >2013-12-04 05:02:43,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8af1d1e5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc17b5a3}, log id: aa6c1db >2013-12-04 05:02:48,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 22dd2daa >2013-12-04 05:02:48,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22dd2daa >2013-12-04 05:02:48,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4c801508 >2013-12-04 05:02:49,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c00e1b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4df08ef0}, log id: 4c801508 >2013-12-04 05:02:54,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 371dd057 >2013-12-04 05:02:54,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 371dd057 >2013-12-04 05:02:54,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 234447e >2013-12-04 05:02:54,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@536751ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@692fca28}, log id: 234447e >2013-12-04 05:02:59,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: c11e6e7 >2013-12-04 05:03:00,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: c11e6e7 >2013-12-04 05:03:00,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c0f7eb2 >2013-12-04 05:03:00,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1794298, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@965d4eb}, log id: 3c0f7eb2 >2013-12-04 05:03:05,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 423c902 >2013-12-04 05:03:06,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 423c902 >2013-12-04 05:03:06,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2966a011 >2013-12-04 05:03:06,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74f1771, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5866105}, log id: 2966a011 >2013-12-04 05:03:11,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7d92d442 >2013-12-04 05:03:12,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d92d442 >2013-12-04 05:03:12,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 19e02385 >2013-12-04 05:03:12,314 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-04 05:03:12,314 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:03:12,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@742771d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a6a6a69}, log id: 19e02385 >2013-12-04 05:03:12,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4a1071d6 >2013-12-04 05:03:12,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4a1071d6 >2013-12-04 05:03:17,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 72fa5e23 >2013-12-04 05:03:17,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 72fa5e23 >2013-12-04 05:03:17,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f571bbb >2013-12-04 05:03:18,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc0e5cb1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96043428}, log id: 4f571bbb >2013-12-04 05:03:23,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 334b2533 >2013-12-04 05:03:23,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 334b2533 >2013-12-04 05:03:23,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ca169ce >2013-12-04 05:03:23,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcabdb88, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2718e0e4}, log id: 4ca169ce >2013-12-04 05:03:29,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e82b6d0 >2013-12-04 05:03:29,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e82b6d0 >2013-12-04 05:03:29,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6bab1f00 >2013-12-04 05:03:29,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9e1f19c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd0d643e}, log id: 6bab1f00 >2013-12-04 05:03:34,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79ee693b >2013-12-04 05:03:35,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 79ee693b >2013-12-04 05:03:35,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 50271faf >2013-12-04 05:03:35,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7a034d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dd58920}, log id: 50271faf >2013-12-04 05:03:40,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4fc6aef3 >2013-12-04 05:03:41,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4fc6aef3 >2013-12-04 05:03:41,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e07815c >2013-12-04 05:03:41,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87502bb8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d10c781}, log id: 6e07815c >2013-12-04 05:03:46,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18cb023d >2013-12-04 05:03:46,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 18cb023d >2013-12-04 05:03:46,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46a892fa >2013-12-04 05:03:47,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba3eb018, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57105a03}, log id: 46a892fa >2013-12-04 05:03:52,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f7fe79f >2013-12-04 05:03:52,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5f7fe79f >2013-12-04 05:03:52,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2406885 >2013-12-04 05:03:52,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc96a77d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2224fe7}, log id: 2406885 >2013-12-04 05:03:56,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47cde65f >2013-12-04 05:03:57,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5a34ab2d, log id: 47cde65f >2013-12-04 05:03:57,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37d2459f >2013-12-04 05:03:57,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5d45170b, log id: 37d2459f >2013-12-04 05:03:58,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59ffb92c >2013-12-04 05:03:58,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 59ffb92c >2013-12-04 05:03:58,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e7b878f >2013-12-04 05:03:58,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6dec615, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@736e9aa9}, log id: 2e7b878f >2013-12-04 05:04:03,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d756ff0 >2013-12-04 05:04:04,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d756ff0 >2013-12-04 05:04:04,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4853cf63 >2013-12-04 05:04:04,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f29cb016, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42ce159a}, log id: 4853cf63 >2013-12-04 05:04:09,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56f8f4 >2013-12-04 05:04:10,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 56f8f4 >2013-12-04 05:04:10,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 556ab9d5 >2013-12-04 05:04:10,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee91bd3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6e225d4}, log id: 556ab9d5 >2013-12-04 05:04:12,620 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-04 05:04:12,620 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:04:12,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30897689 >2013-12-04 05:04:12,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 30897689 >2013-12-04 05:04:15,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 361169c8 >2013-12-04 05:04:15,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 361169c8 >2013-12-04 05:04:15,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1fc02b46 >2013-12-04 05:04:16,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ae3783b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0316e0a}, log id: 1fc02b46 >2013-12-04 05:04:21,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 77065f01 >2013-12-04 05:04:21,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 77065f01 >2013-12-04 05:04:21,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2152561f >2013-12-04 05:04:22,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@401b4697, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fd787fd}, log id: 2152561f >2013-12-04 05:04:27,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e1f8db3 >2013-12-04 05:04:27,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7e1f8db3 >2013-12-04 05:04:27,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 9405ba0 >2013-12-04 05:04:27,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9b77121, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@510271b}, log id: 9405ba0 >2013-12-04 05:04:32,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 222a7a24 >2013-12-04 05:04:33,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 222a7a24 >2013-12-04 05:04:33,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d0cc6d3 >2013-12-04 05:04:33,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bb2b737, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ef1f2bb}, log id: 3d0cc6d3 >2013-12-04 05:04:38,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 11d8a763 >2013-12-04 05:04:39,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11d8a763 >2013-12-04 05:04:39,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 33ba0140 >2013-12-04 05:04:39,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33a3f505, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66494cc0}, log id: 33ba0140 >2013-12-04 05:04:44,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14fd3710 >2013-12-04 05:04:45,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 14fd3710 >2013-12-04 05:04:45,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 898bd51 >2013-12-04 05:04:45,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a38407d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce4f77a8}, log id: 898bd51 >2013-12-04 05:04:50,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 656f3d0a >2013-12-04 05:04:50,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 656f3d0a >2013-12-04 05:04:50,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4e21c9af >2013-12-04 05:04:51,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0958f82, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdff19bd}, log id: 4e21c9af >2013-12-04 05:04:56,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 14b795b8 >2013-12-04 05:04:56,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14b795b8 >2013-12-04 05:04:56,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 117beaf1 >2013-12-04 05:04:56,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f4c30b6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5565476}, log id: 117beaf1 >2013-12-04 05:05:01,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5924f667 >2013-12-04 05:05:02,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5924f667 >2013-12-04 05:05:02,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 795b58a2 >2013-12-04 05:05:02,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37b9364a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce93d1e4}, log id: 795b58a2 >2013-12-04 05:05:07,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 14476b6c >2013-12-04 05:05:08,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 14476b6c >2013-12-04 05:05:08,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7cd1ea87 >2013-12-04 05:05:08,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6b455c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4945555}, log id: 7cd1ea87 >2013-12-04 05:05:12,928 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) No up server in cluster >2013-12-04 05:05:12,928 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:05:12,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17bafbf4 >2013-12-04 05:05:13,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterTasksListVDSCommand, return: [], log id: 17bafbf4 >2013-12-04 05:05:13,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6ef9bae5 >2013-12-04 05:05:14,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ef9bae5 >2013-12-04 05:05:14,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4b7a81d7 >2013-12-04 05:05:14,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b491dab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bbed643}, log id: 4b7a81d7 >2013-12-04 05:05:19,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 585f3441 >2013-12-04 05:05:19,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 585f3441 >2013-12-04 05:05:19,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 242bb3d5 >2013-12-04 05:05:20,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@503c7548, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e9d3e8c}, log id: 242bb3d5 >2013-12-04 05:05:25,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b0fdc85 >2013-12-04 05:05:25,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b0fdc85 >2013-12-04 05:05:25,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e125403 >2013-12-04 05:05:26,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6eebda7d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5506229}, log id: 2e125403 >2013-12-04 05:05:31,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e702e35 >2013-12-04 05:05:31,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: e702e35 >2013-12-04 05:05:31,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a28d21f >2013-12-04 05:05:31,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2ae34c7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90fe88dd}, log id: a28d21f >2013-12-04 05:05:36,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 618c9acb >2013-12-04 05:05:37,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 618c9acb >2013-12-04 05:05:37,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 15854b8e >2013-12-04 05:05:37,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b08404c3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50e1468a}, log id: 15854b8e >2013-12-04 05:05:42,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 548740cf >2013-12-04 05:05:43,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 548740cf >2013-12-04 05:05:43,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f34df9 >2013-12-04 05:05:43,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f50a4cc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc26dc6a}, log id: 7f34df9 >2013-12-04 05:05:48,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5e6adc6c >2013-12-04 05:05:49,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e6adc6c >2013-12-04 05:05:49,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1e22c1da >2013-12-04 05:05:49,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d617f6e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c0a448}, log id: 1e22c1da >2013-12-04 05:05:54,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16fe6e2e >2013-12-04 05:05:54,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 16fe6e2e >2013-12-04 05:05:54,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27f4bb69 >2013-12-04 05:05:55,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a42586c9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f296ae1f}, log id: 27f4bb69 >2013-12-04 05:06:00,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 748ed7be >2013-12-04 05:06:00,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 748ed7be >2013-12-04 05:06:00,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2f49023a >2013-12-04 05:06:00,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ead17da5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fb1fcd5}, log id: 2f49023a >2013-12-04 05:06:05,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30ea3848 >2013-12-04 05:06:06,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 30ea3848 >2013-12-04 05:06:06,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15a75e2f >2013-12-04 05:06:06,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18821f6b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@814ae210}, log id: 15a75e2f >2013-12-04 05:06:11,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70dbf99a >2013-12-04 05:06:12,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 70dbf99a >2013-12-04 05:06:12,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3fa58ba1 >2013-12-04 05:06:12,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5f606ce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@440a9da6}, log id: 3fa58ba1 >2013-12-04 05:06:13,238 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-04 05:06:13,239 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:06:13,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5349167a >2013-12-04 05:06:13,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5349167a >2013-12-04 05:06:17,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 689d9d62 >2013-12-04 05:06:18,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 689d9d62 >2013-12-04 05:06:18,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 35bfa0e7 >2013-12-04 05:06:18,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c6e80f5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfcf468b}, log id: 35bfa0e7 >2013-12-04 05:06:23,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6550b0de >2013-12-04 05:06:23,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6550b0de >2013-12-04 05:06:23,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a2a6b83 >2013-12-04 05:06:24,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@247e83f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7d86163}, log id: 6a2a6b83 >2013-12-04 05:06:29,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 72e8c2fc >2013-12-04 05:06:29,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 72e8c2fc >2013-12-04 05:06:29,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 42e1d06c >2013-12-04 05:06:30,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4a61c8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75e0a80c}, log id: 42e1d06c >2013-12-04 05:06:35,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30d5a9e6 >2013-12-04 05:06:35,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 30d5a9e6 >2013-12-04 05:06:35,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 436a7e63 >2013-12-04 05:06:35,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cc223c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88925796}, log id: 436a7e63 >2013-12-04 05:06:40,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6f728f8f >2013-12-04 05:06:41,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f728f8f >2013-12-04 05:06:41,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 61b5c4f5 >2013-12-04 05:06:41,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4320030, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6200c3}, log id: 61b5c4f5 >2013-12-04 05:06:46,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ecf330d >2013-12-04 05:06:47,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: ecf330d >2013-12-04 05:06:47,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ecd24 >2013-12-04 05:06:47,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ea55c13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1613cd1}, log id: 6ecd24 >2013-12-04 05:06:52,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f877043 >2013-12-04 05:06:53,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f877043 >2013-12-04 05:06:53,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a82f48d >2013-12-04 05:06:53,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e6956a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1968839}, log id: 7a82f48d >2013-12-04 05:06:58,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4690bdc1 >2013-12-04 05:06:58,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4690bdc1 >2013-12-04 05:06:58,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3bd4bfc6 >2013-12-04 05:06:59,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a29cfdd0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fcb2dc0}, log id: 3bd4bfc6 >2013-12-04 05:07:04,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1e30a609 >2013-12-04 05:07:04,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1e30a609 >2013-12-04 05:07:04,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2a51a598 >2013-12-04 05:07:04,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82cc8ac8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50fef9dc}, log id: 2a51a598 >2013-12-04 05:07:10,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 567cdbef >2013-12-04 05:07:10,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 567cdbef >2013-12-04 05:07:10,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 77d3cc67 >2013-12-04 05:07:10,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d81ae0dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55764d45}, log id: 77d3cc67 >2013-12-04 05:07:13,542 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-04 05:07:13,542 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:07:13,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27a6549f >2013-12-04 05:07:13,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: 27a6549f >2013-12-04 05:07:15,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66397fb8 >2013-12-04 05:07:16,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 66397fb8 >2013-12-04 05:07:16,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d97b317 >2013-12-04 05:07:16,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@466607e2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6681198}, log id: 2d97b317 >2013-12-04 05:07:21,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 301d30b3 >2013-12-04 05:07:22,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 301d30b3 >2013-12-04 05:07:22,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3f9e7ca >2013-12-04 05:07:22,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@507eb43a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2b036dd}, log id: 3f9e7ca >2013-12-04 05:07:27,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4eb78290 >2013-12-04 05:07:27,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4eb78290 >2013-12-04 05:07:27,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45e3775c >2013-12-04 05:07:28,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd6a3bd2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a881692c}, log id: 45e3775c >2013-12-04 05:07:33,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1733b3b3 >2013-12-04 05:07:33,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1733b3b3 >2013-12-04 05:07:33,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4f8a776a >2013-12-04 05:07:34,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21b3201b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b9cfa42}, log id: 4f8a776a >2013-12-04 05:07:39,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1f5b8eaa >2013-12-04 05:07:39,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f5b8eaa >2013-12-04 05:07:39,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 61533044 >2013-12-04 05:07:39,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adb6db46, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b23a29df}, log id: 61533044 >2013-12-04 05:07:44,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 593f41a3 >2013-12-04 05:07:45,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 593f41a3 >2013-12-04 05:07:45,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7846c9c7 >2013-12-04 05:07:45,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@639105db, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67896f53}, log id: 7846c9c7 >2013-12-04 05:07:50,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6458eaff >2013-12-04 05:07:51,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6458eaff >2013-12-04 05:07:51,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e89ee40 >2013-12-04 05:07:51,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efb0e635, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@918a7cc3}, log id: 5e89ee40 >2013-12-04 05:07:56,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7ac0a75 >2013-12-04 05:07:57,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ac0a75 >2013-12-04 05:07:57,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 722101f0 >2013-12-04 05:07:57,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0e83645, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a58ac97}, log id: 722101f0 >2013-12-04 05:08:02,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1cc7589c >2013-12-04 05:08:02,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cc7589c >2013-12-04 05:08:02,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7720a23e >2013-12-04 05:08:03,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35bebbaf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6cbd867}, log id: 7720a23e >2013-12-04 05:08:08,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10ad3f71 >2013-12-04 05:08:08,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 10ad3f71 >2013-12-04 05:08:08,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32aa4f36 >2013-12-04 05:08:08,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@972bac27, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62704ae3}, log id: 32aa4f36 >2013-12-04 05:08:13,876 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) No up server in cluster >2013-12-04 05:08:13,877 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:08:13,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 245d1b16 >2013-12-04 05:08:13,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 33e86708 >2013-12-04 05:08:14,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, return: [], log id: 245d1b16 >2013-12-04 05:08:14,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 33e86708 >2013-12-04 05:08:14,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5b61d552 >2013-12-04 05:08:14,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9149ca83, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eac154f2}, log id: 5b61d552 >2013-12-04 05:08:19,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 501f1197 >2013-12-04 05:08:20,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 501f1197 >2013-12-04 05:08:20,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6753314b >2013-12-04 05:08:20,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e92c1555, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2dac5013}, log id: 6753314b >2013-12-04 05:08:25,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6deb9b77 >2013-12-04 05:08:26,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6deb9b77 >2013-12-04 05:08:26,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5baae08c >2013-12-04 05:08:26,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@396f4c59, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce664812}, log id: 5baae08c >2013-12-04 05:08:31,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d1154a5 >2013-12-04 05:08:31,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: d1154a5 >2013-12-04 05:08:31,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: fb48f46 >2013-12-04 05:08:32,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efeb3ee8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e19cc34}, log id: fb48f46 >2013-12-04 05:08:37,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4a2b872c >2013-12-04 05:08:37,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a2b872c >2013-12-04 05:08:37,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 28a968b1 >2013-12-04 05:08:38,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1041a36b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db9abf10}, log id: 28a968b1 >2013-12-04 05:08:43,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d493e02 >2013-12-04 05:08:43,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d493e02 >2013-12-04 05:08:43,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b8e49bd >2013-12-04 05:08:43,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f16d2653, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44351220}, log id: 6b8e49bd >2013-12-04 05:08:48,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2815fb02 >2013-12-04 05:08:49,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2815fb02 >2013-12-04 05:08:49,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5e753172 >2013-12-04 05:08:49,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2d73c3c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffd23deb}, log id: 5e753172 >2013-12-04 05:08:54,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67c62145 >2013-12-04 05:08:55,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 67c62145 >2013-12-04 05:08:55,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: b5f18ed >2013-12-04 05:08:55,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3037f09, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35b1a5b1}, log id: b5f18ed >2013-12-04 05:08:57,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2df4344e >2013-12-04 05:08:57,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@59cdbd26, log id: 2df4344e >2013-12-04 05:08:57,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 523d37d9 >2013-12-04 05:08:58,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@c09d08c, log id: 523d37d9 >2013-12-04 05:09:00,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b4ae53c >2013-12-04 05:09:01,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b4ae53c >2013-12-04 05:09:01,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39130383 >2013-12-04 05:09:01,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5285334a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b2e9b0b}, log id: 39130383 >2013-12-04 05:09:06,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58d29668 >2013-12-04 05:09:06,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 58d29668 >2013-12-04 05:09:06,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e017006 >2013-12-04 05:09:07,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f18dd8e5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9eedbfbe}, log id: 7e017006 >2013-12-04 05:09:12,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 300419dc >2013-12-04 05:09:12,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 300419dc >2013-12-04 05:09:12,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3595afe9 >2013-12-04 05:09:13,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3f25ee6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e3ca197}, log id: 3595afe9 >2013-12-04 05:09:14,168 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) No up server in cluster >2013-12-04 05:09:14,169 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:09:14,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5070db99 >2013-12-04 05:09:14,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5070db99 >2013-12-04 05:09:18,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 33955782 >2013-12-04 05:09:18,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 33955782 >2013-12-04 05:09:18,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 61820711 >2013-12-04 05:09:18,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a164026b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cbc090b}, log id: 61820711 >2013-12-04 05:09:23,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63a5f7aa >2013-12-04 05:09:24,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 63a5f7aa >2013-12-04 05:09:24,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70f7add0 >2013-12-04 05:09:24,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b6cb578, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a28d2a89}, log id: 70f7add0 >2013-12-04 05:09:29,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2e26e519 >2013-12-04 05:09:30,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e26e519 >2013-12-04 05:09:30,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5922b576 >2013-12-04 05:09:30,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@945d3837, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fee5e6ab}, log id: 5922b576 >2013-12-04 05:09:35,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 148eba7e >2013-12-04 05:09:36,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 148eba7e >2013-12-04 05:09:36,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1d5c05c3 >2013-12-04 05:09:36,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0c4784c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64507c9d}, log id: 1d5c05c3 >2013-12-04 05:09:41,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 17a05603 >2013-12-04 05:09:41,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17a05603 >2013-12-04 05:09:41,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5421bb88 >2013-12-04 05:09:42,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad36639c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df1c582}, log id: 5421bb88 >2013-12-04 05:09:47,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4dd3d34a >2013-12-04 05:09:47,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4dd3d34a >2013-12-04 05:09:47,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 695f529a >2013-12-04 05:09:48,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36fc121e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a47bf4c}, log id: 695f529a >2013-12-04 05:09:53,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d2ae2b9 >2013-12-04 05:09:53,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: d2ae2b9 >2013-12-04 05:09:53,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 28d3edc8 >2013-12-04 05:09:53,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d149796, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dea791a8}, log id: 28d3edc8 >2013-12-04 05:09:57,923 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-1) Running command: LoginAdminUserCommand internal: false. >2013-12-04 05:09:58,245 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2013-12-04 05:09:58,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f6fd6ae >2013-12-04 05:09:59,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4f6fd6ae >2013-12-04 05:09:59,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 25afeb2d >2013-12-04 05:09:59,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c81fc6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5c28c82}, log id: 25afeb2d >2013-12-04 05:10:00,043 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-13) Running command: LoginUserCommand internal: false. >2013-12-04 05:10:00,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-13) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2013-12-04 05:10:04,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 54ccd208 >2013-12-04 05:10:05,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 54ccd208 >2013-12-04 05:10:05,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5969e9ef >2013-12-04 05:10:05,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f01cffff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba8173c4}, log id: 5969e9ef >2013-12-04 05:10:07,419 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-1) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 05:10:10,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7e38e807 >2013-12-04 05:10:11,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e38e807 >2013-12-04 05:10:11,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3064fed6 >2013-12-04 05:10:11,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e64a43b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e6df99c}, log id: 3064fed6 >2013-12-04 05:10:14,468 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-04 05:10:14,468 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:10:14,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2552238a >2013-12-04 05:10:14,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2552238a >2013-12-04 05:10:16,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d9fdf77 >2013-12-04 05:10:16,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d9fdf77 >2013-12-04 05:10:16,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 31c020d3 >2013-12-04 05:10:17,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ca05d2f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b462d79a}, log id: 31c020d3 >2013-12-04 05:10:22,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1d2f32a9 >2013-12-04 05:10:22,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d2f32a9 >2013-12-04 05:10:22,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6bb169f9 >2013-12-04 05:10:23,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7f1a0ca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@516f45d9}, log id: 6bb169f9 >2013-12-04 05:10:28,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17ebb881 >2013-12-04 05:10:28,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 17ebb881 >2013-12-04 05:10:28,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28878ad2 >2013-12-04 05:10:28,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@840706cb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@121009b4}, log id: 28878ad2 >2013-12-04 05:10:33,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: cbc8368 >2013-12-04 05:10:34,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: cbc8368 >2013-12-04 05:10:34,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: e96fcd4 >2013-12-04 05:10:34,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84d566a1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25868ebb}, log id: e96fcd4 >2013-12-04 05:10:39,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a726c2e >2013-12-04 05:10:40,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1a726c2e >2013-12-04 05:10:40,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3bcded28 >2013-12-04 05:10:40,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72ef4ef9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f973ee12}, log id: 3bcded28 >2013-12-04 05:10:45,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1226a015 >2013-12-04 05:10:46,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1226a015 >2013-12-04 05:10:46,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5353a34b >2013-12-04 05:10:46,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a0b969f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41452d57}, log id: 5353a34b >2013-12-04 05:10:51,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d621e6f >2013-12-04 05:10:51,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3d621e6f >2013-12-04 05:10:51,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7561f866 >2013-12-04 05:10:52,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59b40fad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c5a4a72}, log id: 7561f866 >2013-12-04 05:10:57,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4f2f52d7 >2013-12-04 05:10:57,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f2f52d7 >2013-12-04 05:10:57,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 51af666b >2013-12-04 05:10:58,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de555e29, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cf5e59f}, log id: 51af666b >2013-12-04 05:11:03,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6dd968a9 >2013-12-04 05:11:03,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dd968a9 >2013-12-04 05:11:03,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 77950071 >2013-12-04 05:11:03,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d095d1b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@490460b3}, log id: 77950071 >2013-12-04 05:11:05,823 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-11) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 05:11:08,706 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-8) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 05:11:08,765 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-5) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 05:11:08,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7cf7ca2c >2013-12-04 05:11:09,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7cf7ca2c >2013-12-04 05:11:09,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36b7498e >2013-12-04 05:11:09,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4eb9fee5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8dfa31a}, log id: 36b7498e >2013-12-04 05:11:14,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3858c264 >2013-12-04 05:11:14,778 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) [3f45b52d] No up server in cluster >2013-12-04 05:11:14,778 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) [3f45b52d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:11:14,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 40c9da0a >2013-12-04 05:11:15,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 40c9da0a >2013-12-04 05:11:15,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3858c264 >2013-12-04 05:11:15,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6e4ef364 >2013-12-04 05:11:15,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3dbbcc8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be20ce0c}, log id: 6e4ef364 >2013-12-04 05:11:20,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a205b92 >2013-12-04 05:11:21,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a205b92 >2013-12-04 05:11:21,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5326e48a >2013-12-04 05:11:21,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbf8b3a0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f97fcec}, log id: 5326e48a >2013-12-04 05:11:26,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4031e274 >2013-12-04 05:11:26,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4031e274 >2013-12-04 05:11:26,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22840f1f >2013-12-04 05:11:27,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@434547da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21083700}, log id: 22840f1f >2013-12-04 05:11:32,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 132b20d3 >2013-12-04 05:11:32,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 132b20d3 >2013-12-04 05:11:32,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 224a5231 >2013-12-04 05:11:32,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13efe337, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c20c2f4e}, log id: 224a5231 >2013-12-04 05:11:35,658 INFO [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand] (ajp-/127.0.0.1:8702-4) [1b8779aa] Running command: CreateGlusterVolumeCommand internal: false. Entities affected : ID: 70e19cf2-4ea8-40ed-b899-62a82c916654 Type: VdsGroups >2013-12-04 05:11:35,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand] (ajp-/127.0.0.1:8702-4) [1b8779aa] START, CreateGlusterVolumeVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 118c8c43 >2013-12-04 05:11:36,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand] (ajp-/127.0.0.1:8702-4) [1b8779aa] FINISH, CreateGlusterVolumeVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abc33718, log id: 118c8c43 >2013-12-04 05:11:37,060 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [1b8779aa] Correlation ID: 1b8779aa, Job ID: 0f2f3502-5cbd-4868-a99c-de0239d8fdfa, Call Stack: null, Custom Event ID: -1, Message: Gluster Volume rep_vol created. >2013-12-04 05:11:37,116 INFO [org.ovirt.engine.core.bll.gluster.SetGlusterVolumeOptionCommand] (ajp-/127.0.0.1:8702-4) [452d91d4] Running command: SetGlusterVolumeOptionCommand internal: true. Entities affected : ID: d30a6e61-21b8-4789-a488-e4c142aa55ee Type: GlusterVolume >2013-12-04 05:11:37,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (ajp-/127.0.0.1:8702-4) [452d91d4] START, SetGlusterVolumeOptionVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1d47a1ab >2013-12-04 05:11:37,989 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-91) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:11:38,299 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-91) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:11:38,352 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-91) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:11:38,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (ajp-/127.0.0.1:8702-4) [452d91d4] FINISH, SetGlusterVolumeOptionVDSCommand, log id: 1d47a1ab >2013-12-04 05:11:38,447 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [452d91d4] Correlation ID: 452d91d4, Job ID: 0f2f3502-5cbd-4868-a99c-de0239d8fdfa, Call Stack: null, Custom Event ID: -1, Message: Volume Option nfs.disable=off set on rep_vol. >2013-12-04 05:11:38,481 INFO [org.ovirt.engine.core.bll.gluster.SetGlusterVolumeOptionCommand] (ajp-/127.0.0.1:8702-4) [2566a72e] Running command: SetGlusterVolumeOptionCommand internal: true. Entities affected : ID: d30a6e61-21b8-4789-a488-e4c142aa55ee Type: GlusterVolume >2013-12-04 05:11:38,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (ajp-/127.0.0.1:8702-4) [2566a72e] START, SetGlusterVolumeOptionVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1419af9c >2013-12-04 05:11:38,703 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-91) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:11:39,200 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-91) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:11:40,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (ajp-/127.0.0.1:8702-4) [2566a72e] FINISH, SetGlusterVolumeOptionVDSCommand, log id: 1419af9c >2013-12-04 05:11:40,241 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [2566a72e] Correlation ID: 2566a72e, Job ID: 0f2f3502-5cbd-4868-a99c-de0239d8fdfa, Call Stack: null, Custom Event ID: -1, Message: Volume Option user.cifs=enable set on rep_vol. >2013-12-04 05:11:40,268 INFO [org.ovirt.engine.core.bll.gluster.SetGlusterVolumeOptionCommand] (ajp-/127.0.0.1:8702-4) [3d61444e] Running command: SetGlusterVolumeOptionCommand internal: true. Entities affected : ID: d30a6e61-21b8-4789-a488-e4c142aa55ee Type: GlusterVolume >2013-12-04 05:11:40,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (ajp-/127.0.0.1:8702-4) [3d61444e] START, SetGlusterVolumeOptionVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69570984 >2013-12-04 05:11:41,323 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-91) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:11:41,373 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-91) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:11:41,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.SetGlusterVolumeOptionVDSCommand] (ajp-/127.0.0.1:8702-4) [3d61444e] FINISH, SetGlusterVolumeOptionVDSCommand, log id: 69570984 >2013-12-04 05:11:41,423 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [3d61444e] Correlation ID: 3d61444e, Job ID: 0f2f3502-5cbd-4868-a99c-de0239d8fdfa, Call Stack: null, Custom Event ID: -1, Message: Volume Option auth.allow=* set on rep_vol. >2013-12-04 05:11:41,429 INFO [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand] (ajp-/127.0.0.1:8702-4) [3d61444e] Lock freed to object EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:11:41,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3de7c5c1 >2013-12-04 05:11:41,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3de7c5c1 >2013-12-04 05:11:41,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: e24b602 >2013-12-04 05:11:42,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbf88632, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa41cd84, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4c5e169}, log id: e24b602 >2013-12-04 05:11:47,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14eb3996 >2013-12-04 05:11:47,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 14eb3996 >2013-12-04 05:11:47,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56321e4a >2013-12-04 05:11:48,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d833c7d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71e6296d, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e028945}, log id: 56321e4a >2013-12-04 05:11:53,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f3b3bd9 >2013-12-04 05:11:53,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5f3b3bd9 >2013-12-04 05:11:53,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7c64ba64 >2013-12-04 05:11:54,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af8b42db, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8edbbe35, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@510d4ae2}, log id: 7c64ba64 >2013-12-04 05:11:59,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e017ac7 >2013-12-04 05:11:59,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3e017ac7 >2013-12-04 05:11:59,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1b060d22 >2013-12-04 05:11:59,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f24ed80, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7ee128c, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2762b1f9}, log id: 1b060d22 >2013-12-04 05:12:04,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3193ee4d >2013-12-04 05:12:05,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3193ee4d >2013-12-04 05:12:05,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: c67bc67 >2013-12-04 05:12:05,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aec8f851, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f78c328, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b960b33}, log id: c67bc67 >2013-12-04 05:12:10,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7920cb54 >2013-12-04 05:12:11,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7920cb54 >2013-12-04 05:12:11,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3af8dcfe >2013-12-04 05:12:11,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90356e9a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8e2ec9d, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ca9a1c4}, log id: 3af8dcfe >2013-12-04 05:12:15,077 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-04 05:12:15,078 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:12:15,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 687afeb6 >2013-12-04 05:12:15,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 687afeb6 >2013-12-04 05:12:16,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 718add3e >2013-12-04 05:12:17,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 718add3e >2013-12-04 05:12:17,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 120e3d3 >2013-12-04 05:12:17,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@413110, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42a44079, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9130fc98}, log id: 120e3d3 >2013-12-04 05:12:22,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 330960f7 >2013-12-04 05:12:23,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 330960f7 >2013-12-04 05:12:23,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 31878758 >2013-12-04 05:12:23,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0df1dab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a321377, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e465904}, log id: 31878758 >2013-12-04 05:12:28,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 9ccc443 >2013-12-04 05:12:28,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9ccc443 >2013-12-04 05:12:28,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1b644edc >2013-12-04 05:12:29,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b641d003, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1b15b47, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b16b3bf}, log id: 1b644edc >2013-12-04 05:12:34,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 34329c9e >2013-12-04 05:12:34,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34329c9e >2013-12-04 05:12:34,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6265a1ae >2013-12-04 05:12:35,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd7741ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ee24572, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9ce2583}, log id: 6265a1ae >2013-12-04 05:12:40,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6c9e3649 >2013-12-04 05:12:40,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c9e3649 >2013-12-04 05:12:40,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 345b40d0 >2013-12-04 05:12:40,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0d91a4b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3af968d7, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c05d3b4e}, log id: 345b40d0 >2013-12-04 05:12:41,021 INFO [org.ovirt.engine.core.bll.gluster.StartGlusterVolumeCommand] (pool-4-thread-50) [55074a86] Running command: StartGlusterVolumeCommand internal: false. Entities affected : ID: d30a6e61-21b8-4789-a488-e4c142aa55ee Type: GlusterVolume >2013-12-04 05:12:41,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartGlusterVolumeVDSCommand] (pool-4-thread-50) [55074a86] START, StartGlusterVolumeVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4fe124f2 >2013-12-04 05:12:43,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartGlusterVolumeVDSCommand] (pool-4-thread-50) [55074a86] FINISH, StartGlusterVolumeVDSCommand, log id: 4fe124f2 >2013-12-04 05:12:43,966 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-50) [55074a86] Correlation ID: 55074a86, Job ID: ce63ed9d-86ec-4019-b8e5-8e5642613130, Call Stack: null, Custom Event ID: -1, Message: Gluster Volume rep_vol started. >2013-12-04 05:12:43,977 INFO [org.ovirt.engine.core.bll.gluster.StartGlusterVolumeCommand] (pool-4-thread-50) [55074a86] Lock freed to object EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:12:46,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79eafc62 >2013-12-04 05:12:46,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 79eafc62 >2013-12-04 05:12:46,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b2df078 >2013-12-04 05:12:46,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f82619bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2e8212f, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37995b12}, log id: 2b2df078 >2013-12-04 05:12:52,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 560b186c >2013-12-04 05:12:52,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 560b186c >2013-12-04 05:12:52,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b0eb668 >2013-12-04 05:12:52,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b41d293c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75e6fb95, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3d2dc3b}, log id: 6b0eb668 >2013-12-04 05:12:55,361 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-1) [9a8fc1a] Running command: LogoutUserCommand internal: false. >2013-12-04 05:12:55,367 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-17) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 05:12:55,384 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [9a8fc1a] Correlation ID: 9a8fc1a, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2013-12-04 05:12:57,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58f2bd9f >2013-12-04 05:12:58,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 58f2bd9f >2013-12-04 05:12:58,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ada47a0 >2013-12-04 05:12:58,527 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-2) Running command: LoginAdminUserCommand internal: false. >2013-12-04 05:12:58,536 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2013-12-04 05:12:58,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4099533, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5027d0, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91c3b5cc}, log id: ada47a0 >2013-12-04 05:13:03,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5d577001 >2013-12-04 05:13:04,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d577001 >2013-12-04 05:13:04,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 340fad3e >2013-12-04 05:13:04,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@237461b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ad880d8, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@272a54ae}, log id: 340fad3e >2013-12-04 05:13:04,865 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-13) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 05:13:08,584 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-15) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 05:13:09,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 65203712 >2013-12-04 05:13:10,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 65203712 >2013-12-04 05:13:10,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5af6498e >2013-12-04 05:13:10,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17e55c26, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0a79969, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bab19d}, log id: 5af6498e >2013-12-04 05:13:12,323 INFO [org.ovirt.engine.core.bll.gluster.StopGlusterVolumeCommand] (pool-4-thread-25) [54388706] Running command: StopGlusterVolumeCommand internal: false. Entities affected : ID: d30a6e61-21b8-4789-a488-e4c142aa55ee Type: GlusterVolume >2013-12-04 05:13:12,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.StopGlusterVolumeVDSCommand] (pool-4-thread-25) [54388706] START, StopGlusterVolumeVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f53d42 >2013-12-04 05:13:15,397 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) [451f957d] No up server in cluster >2013-12-04 05:13:15,398 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) [451f957d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:13:15,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ef2f4a9 >2013-12-04 05:13:15,507 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-63) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:13:15,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.StopGlusterVolumeVDSCommand] (pool-4-thread-25) [54388706] FINISH, StopGlusterVolumeVDSCommand, log id: 5f53d42 >2013-12-04 05:13:15,566 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-25) [54388706] Correlation ID: 54388706, Job ID: 8b8e71e7-be7d-4199-b79a-9314623e4582, Call Stack: null, Custom Event ID: -1, Message: Gluster Volume rep_vol stopped. >2013-12-04 05:13:15,570 INFO [org.ovirt.engine.core.bll.gluster.StopGlusterVolumeCommand] (pool-4-thread-25) [54388706] Lock freed to object EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:13:15,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 67fa6306 >2013-12-04 05:13:15,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3ef2f4a9 >2013-12-04 05:13:16,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 67fa6306 >2013-12-04 05:13:16,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 22652ae4 >2013-12-04 05:13:16,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1b0a2cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a73573eb, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c432a2e3}, log id: 22652ae4 >2013-12-04 05:13:21,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 734137aa >2013-12-04 05:13:21,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 734137aa >2013-12-04 05:13:21,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5e21c3ca >2013-12-04 05:13:22,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e6fb27c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29203963, d30a6e61-21b8-4789-a488-e4c142aa55ee=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bd76e18}, log id: 5e21c3ca >2013-12-04 05:13:25,235 INFO [org.ovirt.engine.core.bll.gluster.DeleteGlusterVolumeCommand] (pool-4-thread-49) [1ef5b93] Running command: DeleteGlusterVolumeCommand internal: false. Entities affected : ID: d30a6e61-21b8-4789-a488-e4c142aa55ee Type: GlusterVolume >2013-12-04 05:13:25,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.DeleteGlusterVolumeVDSCommand] (pool-4-thread-49) [1ef5b93] START, DeleteGlusterVolumeVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24c47da2 >2013-12-04 05:13:25,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.DeleteGlusterVolumeVDSCommand] (pool-4-thread-49) [1ef5b93] FINISH, DeleteGlusterVolumeVDSCommand, log id: 24c47da2 >2013-12-04 05:13:25,913 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-49) [1ef5b93] Correlation ID: 1ef5b93, Job ID: 45f67ea0-acec-4722-abe0-26dab2c807b4, Call Stack: null, Custom Event ID: -1, Message: Gluster Volume rep_vol deleted. >2013-12-04 05:13:25,917 INFO [org.ovirt.engine.core.bll.gluster.DeleteGlusterVolumeCommand] (pool-4-thread-49) [1ef5b93] Lock freed to object EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:13:27,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: ddb999b >2013-12-04 05:13:27,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: ddb999b >2013-12-04 05:13:27,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 606210b5 >2013-12-04 05:13:28,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc42fa10, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31dbb628}, log id: 606210b5 >2013-12-04 05:13:30,374 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-13) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 05:13:33,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3fd3ce3f >2013-12-04 05:13:33,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3fd3ce3f >2013-12-04 05:13:33,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7db4128f >2013-12-04 05:13:33,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45590787, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6806b6c}, log id: 7db4128f >2013-12-04 05:13:38,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f065848 >2013-12-04 05:13:39,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: f065848 >2013-12-04 05:13:39,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 763298c9 >2013-12-04 05:13:39,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f13ad2c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c19df90f}, log id: 763298c9 >2013-12-04 05:13:44,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: d058b23 >2013-12-04 05:13:45,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d058b23 >2013-12-04 05:13:45,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 26ef9965 >2013-12-04 05:13:45,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@945e61af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d4c7128}, log id: 26ef9965 >2013-12-04 05:13:50,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f7f9f8c >2013-12-04 05:13:51,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4f7f9f8c >2013-12-04 05:13:51,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 57387c4d >2013-12-04 05:13:51,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2024dc6f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf3304b6}, log id: 57387c4d >2013-12-04 05:13:56,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 49680e33 >2013-12-04 05:13:56,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49680e33 >2013-12-04 05:13:56,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 41fee85a >2013-12-04 05:13:57,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4c7c8a6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d450273}, log id: 41fee85a >2013-12-04 05:13:58,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ce3538a >2013-12-04 05:13:58,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@52d8b9d1, log id: 1ce3538a >2013-12-04 05:13:58,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 128f72d5 >2013-12-04 05:13:58,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@44e4cdd6, log id: 128f72d5 >2013-12-04 05:14:02,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3694e56b >2013-12-04 05:14:02,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3694e56b >2013-12-04 05:14:02,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 230f562e >2013-12-04 05:14:03,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@708c6f71, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@574c944b}, log id: 230f562e >2013-12-04 05:14:08,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 346863ae >2013-12-04 05:14:08,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 346863ae >2013-12-04 05:14:08,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 326f1968 >2013-12-04 05:14:08,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0a74ff9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbe3dcd8}, log id: 326f1968 >2013-12-04 05:14:13,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f7692f6 >2013-12-04 05:14:14,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6f7692f6 >2013-12-04 05:14:14,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1eb7af4d >2013-12-04 05:14:14,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b8a9c5b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98ef50ba}, log id: 1eb7af4d >2013-12-04 05:14:15,712 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) No up server in cluster >2013-12-04 05:14:15,712 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:14:15,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28d8ba60 >2013-12-04 05:14:16,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterTasksListVDSCommand, return: [], log id: 28d8ba60 >2013-12-04 05:14:19,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 44bde9b8 >2013-12-04 05:14:20,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 44bde9b8 >2013-12-04 05:14:20,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b45e54b >2013-12-04 05:14:20,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4464cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bae8dfbe}, log id: b45e54b >2013-12-04 05:14:25,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e15f0ca >2013-12-04 05:14:26,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3e15f0ca >2013-12-04 05:14:26,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6d6a76d4 >2013-12-04 05:14:26,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f1ef7fe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8ba8f73}, log id: 6d6a76d4 >2013-12-04 05:14:31,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 615399b2 >2013-12-04 05:14:31,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 615399b2 >2013-12-04 05:14:31,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4046b769 >2013-12-04 05:14:32,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79e402dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8ce6146}, log id: 4046b769 >2013-12-04 05:14:37,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2964dfe4 >2013-12-04 05:14:37,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2964dfe4 >2013-12-04 05:14:37,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34706243 >2013-12-04 05:14:38,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89881cb3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@632b4ba3}, log id: 34706243 >2013-12-04 05:14:43,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 77e08d15 >2013-12-04 05:14:43,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77e08d15 >2013-12-04 05:14:43,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6912f40a >2013-12-04 05:14:43,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c82ee830, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c09e5da}, log id: 6912f40a >2013-12-04 05:14:48,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 67fc2dfd >2013-12-04 05:14:49,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67fc2dfd >2013-12-04 05:14:49,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 79259638 >2013-12-04 05:14:49,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc8ff744, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fba61a52}, log id: 79259638 >2013-12-04 05:14:54,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a3196cc >2013-12-04 05:14:55,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7a3196cc >2013-12-04 05:14:55,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3bea96d9 >2013-12-04 05:14:55,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@274b0253, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe301250}, log id: 3bea96d9 >2013-12-04 05:15:00,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5c70ac60 >2013-12-04 05:15:01,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c70ac60 >2013-12-04 05:15:01,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 398b648b >2013-12-04 05:15:01,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd216ee8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67762b67}, log id: 398b648b >2013-12-04 05:15:06,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 607beb16 >2013-12-04 05:15:06,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 607beb16 >2013-12-04 05:15:06,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5d2b5ab9 >2013-12-04 05:15:07,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b9e86ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@511bfdea}, log id: 5d2b5ab9 >2013-12-04 05:15:12,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3fa64f6f >2013-12-04 05:15:12,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fa64f6f >2013-12-04 05:15:12,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41f0c48c >2013-12-04 05:15:13,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@901e8f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@262888af}, log id: 41f0c48c >2013-12-04 05:15:16,028 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-04 05:15:16,028 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:15:16,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 13903d60 >2013-12-04 05:15:16,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 13903d60 >2013-12-04 05:15:18,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78431083 >2013-12-04 05:15:18,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 78431083 >2013-12-04 05:15:18,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3225eee >2013-12-04 05:15:18,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d27b705c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54ceab24}, log id: 3225eee >2013-12-04 05:15:23,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17658ec5 >2013-12-04 05:15:24,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 17658ec5 >2013-12-04 05:15:24,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ddf60a1 >2013-12-04 05:15:24,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20a6486d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9dedb46}, log id: 7ddf60a1 >2013-12-04 05:15:29,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 662403cc >2013-12-04 05:15:30,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 662403cc >2013-12-04 05:15:30,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6deef48b >2013-12-04 05:15:30,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d92218ce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@861aace0}, log id: 6deef48b >2013-12-04 05:15:35,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2acb045e >2013-12-04 05:15:36,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2acb045e >2013-12-04 05:15:36,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 541ec666 >2013-12-04 05:15:36,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f58e43f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ed11291}, log id: 541ec666 >2013-12-04 05:15:41,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 46f6626d >2013-12-04 05:15:41,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46f6626d >2013-12-04 05:15:41,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2b63afaa >2013-12-04 05:15:42,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16f5aa95, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@546247b0}, log id: 2b63afaa >2013-12-04 05:15:47,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 305cb0f3 >2013-12-04 05:15:47,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 305cb0f3 >2013-12-04 05:15:47,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 149833ff >2013-12-04 05:15:48,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9ed9513, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb0c3977}, log id: 149833ff >2013-12-04 05:15:53,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4c075ca1 >2013-12-04 05:15:53,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c075ca1 >2013-12-04 05:15:53,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14d3a435 >2013-12-04 05:15:53,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2177aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b268228}, log id: 14d3a435 >2013-12-04 05:15:58,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4bd71c96 >2013-12-04 05:15:59,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bd71c96 >2013-12-04 05:15:59,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4a01e717 >2013-12-04 05:15:59,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ef27bf5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffb59b9e}, log id: 4a01e717 >2013-12-04 05:16:04,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 22d74819 >2013-12-04 05:16:05,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 22d74819 >2013-12-04 05:16:05,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b6f36dc >2013-12-04 05:16:05,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ac78aff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64116094}, log id: 4b6f36dc >2013-12-04 05:16:10,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ca37cc0 >2013-12-04 05:16:11,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ca37cc0 >2013-12-04 05:16:11,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ae69098 >2013-12-04 05:16:11,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e09fadc4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99a5b1c4}, log id: 4ae69098 >2013-12-04 05:16:16,344 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-04 05:16:16,344 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:16:16,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 659d6265 >2013-12-04 05:16:16,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7b83e119 >2013-12-04 05:16:16,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 659d6265 >2013-12-04 05:16:16,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b83e119 >2013-12-04 05:16:16,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4e958855 >2013-12-04 05:16:17,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@daa5289, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14626550}, log id: 4e958855 >2013-12-04 05:16:22,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 45c288f7 >2013-12-04 05:16:22,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45c288f7 >2013-12-04 05:16:22,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 66a30bda >2013-12-04 05:16:22,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@366a9f23, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36f78a45}, log id: 66a30bda >2013-12-04 05:16:27,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 37efbddb >2013-12-04 05:16:28,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 37efbddb >2013-12-04 05:16:28,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 52d2813b >2013-12-04 05:16:28,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@628cc37a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2824530}, log id: 52d2813b >2013-12-04 05:16:33,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2dd72a62 >2013-12-04 05:16:34,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2dd72a62 >2013-12-04 05:16:34,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1858ad62 >2013-12-04 05:16:34,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@381f0b0d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30caa56d}, log id: 1858ad62 >2013-12-04 05:16:39,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c1771e7 >2013-12-04 05:16:40,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3c1771e7 >2013-12-04 05:16:40,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29cf84b0 >2013-12-04 05:16:40,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c56b56fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5818c9ae}, log id: 29cf84b0 >2013-12-04 05:16:45,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2a73c72d >2013-12-04 05:16:45,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2a73c72d >2013-12-04 05:16:45,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b58ee35 >2013-12-04 05:16:46,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd549dd3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6b0a2cb}, log id: 4b58ee35 >2013-12-04 05:16:51,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75ebf970 >2013-12-04 05:16:51,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 75ebf970 >2013-12-04 05:16:51,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 922d81 >2013-12-04 05:16:52,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9032b139, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71dc8d41}, log id: 922d81 >2013-12-04 05:16:57,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20df1e15 >2013-12-04 05:16:57,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 20df1e15 >2013-12-04 05:16:57,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 142f28d2 >2013-12-04 05:16:57,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83601a01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5162c06}, log id: 142f28d2 >2013-12-04 05:17:02,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1cf070f5 >2013-12-04 05:17:03,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1cf070f5 >2013-12-04 05:17:03,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a797f9f >2013-12-04 05:17:03,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c44ac16, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61941269}, log id: 4a797f9f >2013-12-04 05:17:08,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 661acf33 >2013-12-04 05:17:09,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 661acf33 >2013-12-04 05:17:09,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e4a044f >2013-12-04 05:17:09,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae1685fe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e93cbfa}, log id: 1e4a044f >2013-12-04 05:17:14,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 29dc53b >2013-12-04 05:17:15,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 29dc53b >2013-12-04 05:17:15,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 33505f66 >2013-12-04 05:17:15,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b011ee2f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2069707f}, log id: 33505f66 >2013-12-04 05:17:16,648 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) No up server in cluster >2013-12-04 05:17:16,648 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:17:16,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38e3d094 >2013-12-04 05:17:16,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterTasksListVDSCommand, return: [], log id: 38e3d094 >2013-12-04 05:17:20,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10630748 >2013-12-04 05:17:20,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 10630748 >2013-12-04 05:17:20,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11c42d1a >2013-12-04 05:17:21,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba8c2d06, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d443e3f}, log id: 11c42d1a >2013-12-04 05:17:26,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e651940 >2013-12-04 05:17:26,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3e651940 >2013-12-04 05:17:26,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7dad622d >2013-12-04 05:17:26,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec55c592, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25a6b320}, log id: 7dad622d >2013-12-04 05:17:32,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4664045f >2013-12-04 05:17:32,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4664045f >2013-12-04 05:17:32,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 484bab1d >2013-12-04 05:17:32,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bbf58fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1f014ba}, log id: 484bab1d >2013-12-04 05:17:37,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 51fc0480 >2013-12-04 05:17:38,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 51fc0480 >2013-12-04 05:17:38,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45aaffd6 >2013-12-04 05:17:38,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5633c167, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e08fe2b}, log id: 45aaffd6 >2013-12-04 05:17:43,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ae8b914 >2013-12-04 05:17:44,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3ae8b914 >2013-12-04 05:17:44,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21c77fc9 >2013-12-04 05:17:44,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b23133cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@666b9c2}, log id: 21c77fc9 >2013-12-04 05:17:49,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7608633b >2013-12-04 05:17:49,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7608633b >2013-12-04 05:17:49,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5beb7d0f >2013-12-04 05:17:50,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f2b5d83, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f5ba1d0}, log id: 5beb7d0f >2013-12-04 05:17:55,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45298a07 >2013-12-04 05:17:55,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 45298a07 >2013-12-04 05:17:55,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 288f581 >2013-12-04 05:17:56,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c44df92, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60a055f8}, log id: 288f581 >2013-12-04 05:18:01,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5eb7e7e7 >2013-12-04 05:18:01,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5eb7e7e7 >2013-12-04 05:18:01,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1f556dd2 >2013-12-04 05:18:01,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fd8d026, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4f91a57}, log id: 1f556dd2 >2013-12-04 05:18:06,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 122e1f91 >2013-12-04 05:18:07,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 122e1f91 >2013-12-04 05:18:07,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4bd64e53 >2013-12-04 05:18:07,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2437714f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7891d47}, log id: 4bd64e53 >2013-12-04 05:18:12,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3381a309 >2013-12-04 05:18:13,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3381a309 >2013-12-04 05:18:13,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 23f87cc7 >2013-12-04 05:18:13,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79d1a148, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81e184a0}, log id: 23f87cc7 >2013-12-04 05:18:16,951 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) No up server in cluster >2013-12-04 05:18:16,951 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:18:16,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1bc329af >2013-12-04 05:18:17,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1bc329af >2013-12-04 05:18:18,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2fc1d1b4 >2013-12-04 05:18:19,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fc1d1b4 >2013-12-04 05:18:19,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3a3b3d5e >2013-12-04 05:18:19,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a80c2cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@369eb903}, log id: 3a3b3d5e >2013-12-04 05:18:24,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 38c0e076 >2013-12-04 05:18:24,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 38c0e076 >2013-12-04 05:18:24,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 548a713b >2013-12-04 05:18:25,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@322b21aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eebd82c}, log id: 548a713b >2013-12-04 05:18:30,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b6faa1b >2013-12-04 05:18:30,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4b6faa1b >2013-12-04 05:18:30,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 76014e6c >2013-12-04 05:18:31,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8995be2c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe82e4d7}, log id: 76014e6c >2013-12-04 05:18:36,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7d8ee0c3 >2013-12-04 05:18:36,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d8ee0c3 >2013-12-04 05:18:36,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 31616b82 >2013-12-04 05:18:36,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98651dc7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8116716}, log id: 31616b82 >2013-12-04 05:18:41,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2362f92d >2013-12-04 05:18:42,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2362f92d >2013-12-04 05:18:42,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10e754af >2013-12-04 05:18:42,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a556e9c9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbc2c7f1}, log id: 10e754af >2013-12-04 05:18:47,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 21409490 >2013-12-04 05:18:48,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 21409490 >2013-12-04 05:18:48,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66b29f79 >2013-12-04 05:18:48,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39edd0ff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcb7ffc4}, log id: 66b29f79 >2013-12-04 05:18:53,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7bc897e >2013-12-04 05:18:53,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7bc897e >2013-12-04 05:18:53,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 415fd57c >2013-12-04 05:18:54,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35a84703, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8883eeb1}, log id: 415fd57c >2013-12-04 05:18:58,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a168e9 >2013-12-04 05:18:58,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@75961c5b, log id: a168e9 >2013-12-04 05:18:58,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 521fd6ac >2013-12-04 05:18:59,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@304410ff, log id: 521fd6ac >2013-12-04 05:18:59,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 345f52f7 >2013-12-04 05:18:59,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 345f52f7 >2013-12-04 05:18:59,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7812994e >2013-12-04 05:19:00,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c217bf3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@494f59cc}, log id: 7812994e >2013-12-04 05:19:05,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7a3ca528 >2013-12-04 05:19:05,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a3ca528 >2013-12-04 05:19:05,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1a07d0c5 >2013-12-04 05:19:05,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@747af044, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6541271}, log id: 1a07d0c5 >2013-12-04 05:19:10,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 65571b1d >2013-12-04 05:19:11,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65571b1d >2013-12-04 05:19:11,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2a74b6a2 >2013-12-04 05:19:11,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93f90069, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a3a18b5}, log id: 2a74b6a2 >2013-12-04 05:19:16,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4caac9a >2013-12-04 05:19:17,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4caac9a >2013-12-04 05:19:17,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5cabc943 >2013-12-04 05:19:17,292 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-83) No up server in cluster >2013-12-04 05:19:17,292 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-83) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:19:17,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c4c2c93 >2013-12-04 05:19:17,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@397dec2a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db3a7957}, log id: 5cabc943 >2013-12-04 05:19:17,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3c4c2c93 >2013-12-04 05:19:22,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 41e3f30d >2013-12-04 05:19:22,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41e3f30d >2013-12-04 05:19:23,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5ae2027e >2013-12-04 05:19:23,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@586c7def, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a29cc60b}, log id: 5ae2027e >2013-12-04 05:19:28,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1dd65674 >2013-12-04 05:19:28,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dd65674 >2013-12-04 05:19:28,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 128e2d67 >2013-12-04 05:19:29,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@807ab051, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5e88d7e}, log id: 128e2d67 >2013-12-04 05:19:34,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 510368a >2013-12-04 05:19:34,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 510368a >2013-12-04 05:19:34,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c27e2b1 >2013-12-04 05:19:34,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cebd9582, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e0d307b}, log id: 6c27e2b1 >2013-12-04 05:19:39,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 73d9e7e8 >2013-12-04 05:19:40,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 73d9e7e8 >2013-12-04 05:19:40,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6d376078 >2013-12-04 05:19:40,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2eb1b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3706a90}, log id: 6d376078 >2013-12-04 05:19:45,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 51477175 >2013-12-04 05:19:46,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 51477175 >2013-12-04 05:19:46,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 17432599 >2013-12-04 05:19:46,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad278069, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4668825d}, log id: 17432599 >2013-12-04 05:19:51,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1b343a54 >2013-12-04 05:19:52,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b343a54 >2013-12-04 05:19:52,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 650ffb13 >2013-12-04 05:19:52,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6a8787c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14a251f6}, log id: 650ffb13 >2013-12-04 05:19:57,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3cc32604 >2013-12-04 05:19:57,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3cc32604 >2013-12-04 05:19:57,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 59672269 >2013-12-04 05:19:58,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd3647e3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff015731}, log id: 59672269 >2013-12-04 05:20:03,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e6642ba >2013-12-04 05:20:03,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e6642ba >2013-12-04 05:20:03,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2c358feb >2013-12-04 05:20:04,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f5311d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23d9ef31}, log id: 2c358feb >2013-12-04 05:20:09,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 756d9668 >2013-12-04 05:20:09,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 756d9668 >2013-12-04 05:20:09,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7d62645e >2013-12-04 05:20:09,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a060a5b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c35c774}, log id: 7d62645e >2013-12-04 05:20:14,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9088209 >2013-12-04 05:20:15,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 9088209 >2013-12-04 05:20:15,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7445601 >2013-12-04 05:20:15,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddc466d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e47dfb11}, log id: 7445601 >2013-12-04 05:20:17,591 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) No up server in cluster >2013-12-04 05:20:17,591 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:20:17,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4f9fefcb >2013-12-04 05:20:17,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4f9fefcb >2013-12-04 05:20:20,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2873c218 >2013-12-04 05:20:21,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2873c218 >2013-12-04 05:20:21,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2c897776 >2013-12-04 05:20:21,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2428ea81, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f394ecd}, log id: 2c897776 >2013-12-04 05:20:26,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 64148486 >2013-12-04 05:20:26,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 64148486 >2013-12-04 05:20:26,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6fc525bc >2013-12-04 05:20:27,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff14c087, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@920446c8}, log id: 6fc525bc >2013-12-04 05:20:32,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: bdc7036 >2013-12-04 05:20:32,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: bdc7036 >2013-12-04 05:20:32,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 77183ec6 >2013-12-04 05:20:33,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20de36da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abc5083d}, log id: 77183ec6 >2013-12-04 05:20:38,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ffa544d >2013-12-04 05:20:39,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ffa544d >2013-12-04 05:20:39,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5031eab8 >2013-12-04 05:20:39,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47b6c922, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d271361}, log id: 5031eab8 >2013-12-04 05:20:44,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4fae441a >2013-12-04 05:20:44,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4fae441a >2013-12-04 05:20:44,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32dffcbd >2013-12-04 05:20:45,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41b9f37f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5b9b2e2}, log id: 32dffcbd >2013-12-04 05:20:50,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ed226b7 >2013-12-04 05:20:50,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ed226b7 >2013-12-04 05:20:50,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77c4b8ee >2013-12-04 05:20:50,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff92d636, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24c212f3}, log id: 77c4b8ee >2013-12-04 05:20:55,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5d44c496 >2013-12-04 05:20:56,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5d44c496 >2013-12-04 05:20:56,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 657bf043 >2013-12-04 05:20:56,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ae22218, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@600934f5}, log id: 657bf043 >2013-12-04 05:21:01,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2eea73e0 >2013-12-04 05:21:02,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2eea73e0 >2013-12-04 05:21:02,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d5a17f1 >2013-12-04 05:21:02,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3824708e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a182995}, log id: 6d5a17f1 >2013-12-04 05:21:07,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6bdf7dc4 >2013-12-04 05:21:08,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bdf7dc4 >2013-12-04 05:21:08,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a1b0f51 >2013-12-04 05:21:08,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@414ddea8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8ae3eea}, log id: 4a1b0f51 >2013-12-04 05:21:13,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ae5a73e >2013-12-04 05:21:13,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ae5a73e >2013-12-04 05:21:13,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34ec1c0 >2013-12-04 05:21:14,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e9acc8c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe74082a}, log id: 34ec1c0 >2013-12-04 05:21:17,897 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-04 05:21:17,897 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:21:17,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7571c4f7 >2013-12-04 05:21:18,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7571c4f7 >2013-12-04 05:21:19,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 60d9e970 >2013-12-04 05:21:19,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 60d9e970 >2013-12-04 05:21:19,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6daad091 >2013-12-04 05:21:20,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64866edd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad2150c4}, log id: 6daad091 >2013-12-04 05:21:25,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3cf24246 >2013-12-04 05:21:25,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3cf24246 >2013-12-04 05:21:25,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 60dcfc93 >2013-12-04 05:21:25,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8a7fdc7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@725112e0}, log id: 60dcfc93 >2013-12-04 05:21:30,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 329dadbb >2013-12-04 05:21:31,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 329dadbb >2013-12-04 05:21:31,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 731827b2 >2013-12-04 05:21:31,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee359fa8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e765e15}, log id: 731827b2 >2013-12-04 05:21:36,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3cd218c >2013-12-04 05:21:37,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3cd218c >2013-12-04 05:21:37,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 280fea48 >2013-12-04 05:21:37,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a34c344, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a674c0cd}, log id: 280fea48 >2013-12-04 05:21:42,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69ec35f0 >2013-12-04 05:21:43,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 69ec35f0 >2013-12-04 05:21:43,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 74d24fc1 >2013-12-04 05:21:43,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34d7023d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b357dfb0}, log id: 74d24fc1 >2013-12-04 05:21:48,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 486c6696 >2013-12-04 05:21:48,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 486c6696 >2013-12-04 05:21:48,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 549dcfae >2013-12-04 05:21:49,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb26c762, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98cb6939}, log id: 549dcfae >2013-12-04 05:21:54,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6495dcd2 >2013-12-04 05:21:54,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6495dcd2 >2013-12-04 05:21:54,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c4fc339 >2013-12-04 05:21:54,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15365677, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa505b79}, log id: 5c4fc339 >2013-12-04 05:21:59,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b2bf36b >2013-12-04 05:22:00,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3b2bf36b >2013-12-04 05:22:00,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 61d43b4f >2013-12-04 05:22:00,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52637303, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adc25c79}, log id: 61d43b4f >2013-12-04 05:22:05,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 768b723e >2013-12-04 05:22:06,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 768b723e >2013-12-04 05:22:06,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 20b6bd0e >2013-12-04 05:22:06,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2510145, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fa99b78}, log id: 20b6bd0e >2013-12-04 05:22:11,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28f9a05b >2013-12-04 05:22:12,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 28f9a05b >2013-12-04 05:22:12,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6819c662 >2013-12-04 05:22:12,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d273141e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@340fd1a6}, log id: 6819c662 >2013-12-04 05:22:17,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39b6ee55 >2013-12-04 05:22:17,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 39b6ee55 >2013-12-04 05:22:17,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47448635 >2013-12-04 05:22:18,194 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) No up server in cluster >2013-12-04 05:22:18,194 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:22:18,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e209239 >2013-12-04 05:22:18,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2da5f6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e19b0a54}, log id: 47448635 >2013-12-04 05:22:18,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7e209239 >2013-12-04 05:22:23,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: e671daf >2013-12-04 05:22:23,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e671daf >2013-12-04 05:22:23,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 591ef245 >2013-12-04 05:22:24,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b40fefa6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55763160}, log id: 591ef245 >2013-12-04 05:22:29,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 454580df >2013-12-04 05:22:29,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 454580df >2013-12-04 05:22:29,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4e13904 >2013-12-04 05:22:29,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3744802f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@613e2c15}, log id: 4e13904 >2013-12-04 05:22:34,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4020b1c9 >2013-12-04 05:22:35,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4020b1c9 >2013-12-04 05:22:35,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10b7c7fb >2013-12-04 05:22:35,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b10af2bf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@698b54b6}, log id: 10b7c7fb >2013-12-04 05:22:40,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b01b080 >2013-12-04 05:22:41,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2b01b080 >2013-12-04 05:22:41,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7c9264e >2013-12-04 05:22:41,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb77b349, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab120515}, log id: 7c9264e >2013-12-04 05:22:46,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: e61ca17 >2013-12-04 05:22:47,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e61ca17 >2013-12-04 05:22:47,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 748dea41 >2013-12-04 05:22:47,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6addc307, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d1e7b69}, log id: 748dea41 >2013-12-04 05:22:52,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 227f3ce1 >2013-12-04 05:22:52,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 227f3ce1 >2013-12-04 05:22:52,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 660ba5a5 >2013-12-04 05:22:53,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7a39bbc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee3477df}, log id: 660ba5a5 >2013-12-04 05:22:58,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5e21c56a >2013-12-04 05:22:58,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5e21c56a >2013-12-04 05:22:58,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 62bdd6c9 >2013-12-04 05:22:58,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89c9ebd3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97ce9f8c}, log id: 62bdd6c9 >2013-12-04 05:23:03,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4672db93 >2013-12-04 05:23:04,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4672db93 >2013-12-04 05:23:04,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1617a301 >2013-12-04 05:23:04,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e49f5e4a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c723d5e7}, log id: 1617a301 >2013-12-04 05:23:09,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5311a620 >2013-12-04 05:23:10,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5311a620 >2013-12-04 05:23:10,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 49537a3b >2013-12-04 05:23:10,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40564bf5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@515ecec9}, log id: 49537a3b >2013-12-04 05:23:15,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ded0f99 >2013-12-04 05:23:16,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1ded0f99 >2013-12-04 05:23:16,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7c832f1f >2013-12-04 05:23:16,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84f1b839, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd75e51e}, log id: 7c832f1f >2013-12-04 05:23:18,496 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-04 05:23:18,496 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:23:18,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7fa97a9c >2013-12-04 05:23:18,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7fa97a9c >2013-12-04 05:23:21,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 65eca149 >2013-12-04 05:23:21,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65eca149 >2013-12-04 05:23:21,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 39f11b2a >2013-12-04 05:23:22,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9775515d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11f19689}, log id: 39f11b2a >2013-12-04 05:23:27,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 17c3d395 >2013-12-04 05:23:27,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 17c3d395 >2013-12-04 05:23:27,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4af576d >2013-12-04 05:23:28,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1c5ef57, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31a88c61}, log id: 4af576d >2013-12-04 05:23:33,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40892b6f >2013-12-04 05:23:33,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 40892b6f >2013-12-04 05:23:33,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39e6ca38 >2013-12-04 05:23:33,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2f57ede, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e012ba34}, log id: 39e6ca38 >2013-12-04 05:23:38,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2a5c6321 >2013-12-04 05:23:39,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a5c6321 >2013-12-04 05:23:39,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47b57523 >2013-12-04 05:23:39,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f2a2ecb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8702b8d6}, log id: 47b57523 >2013-12-04 05:23:44,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54a84fff >2013-12-04 05:23:45,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 54a84fff >2013-12-04 05:23:45,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77d852db >2013-12-04 05:23:45,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d7154d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae34791e}, log id: 77d852db >2013-12-04 05:23:50,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f05b313 >2013-12-04 05:23:51,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6f05b313 >2013-12-04 05:23:51,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1e4f25a >2013-12-04 05:23:51,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2030a598, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee31bce1}, log id: 1e4f25a >2013-12-04 05:23:56,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b83b965 >2013-12-04 05:23:56,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b83b965 >2013-12-04 05:23:56,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1fbbe42c >2013-12-04 05:23:57,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@359244d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7db77d63}, log id: 1fbbe42c >2013-12-04 05:23:59,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f842f70 >2013-12-04 05:23:59,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5f7b7cec, log id: f842f70 >2013-12-04 05:23:59,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 24469aed >2013-12-04 05:23:59,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6c196af, log id: 24469aed >2013-12-04 05:24:02,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: c8ad766 >2013-12-04 05:24:02,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: c8ad766 >2013-12-04 05:24:02,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6b7e08d >2013-12-04 05:24:02,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40fe0064, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39a9e096}, log id: 6b7e08d >2013-12-04 05:24:07,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 317c853a >2013-12-04 05:24:08,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 317c853a >2013-12-04 05:24:08,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 146114ab >2013-12-04 05:24:08,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af440547, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e286daaf}, log id: 146114ab >2013-12-04 05:24:13,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41adf967 >2013-12-04 05:24:14,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 41adf967 >2013-12-04 05:24:14,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 435ed704 >2013-12-04 05:24:14,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@534910d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd1342f1}, log id: 435ed704 >2013-12-04 05:24:18,808 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) No up server in cluster >2013-12-04 05:24:18,809 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:24:18,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 26ee8d93 >2013-12-04 05:24:19,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterTasksListVDSCommand, return: [], log id: 26ee8d93 >2013-12-04 05:24:19,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67afb990 >2013-12-04 05:24:20,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 67afb990 >2013-12-04 05:24:20,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1659cffa >2013-12-04 05:24:20,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c46ef201, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0f5b296}, log id: 1659cffa >2013-12-04 05:24:25,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e85837 >2013-12-04 05:24:25,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3e85837 >2013-12-04 05:24:25,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 30297e8e >2013-12-04 05:24:26,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@134a3567, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aee51c4e}, log id: 30297e8e >2013-12-04 05:24:31,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3516e745 >2013-12-04 05:24:31,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3516e745 >2013-12-04 05:24:31,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4dc7aadc >2013-12-04 05:24:32,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a258891, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@543b9cad}, log id: 4dc7aadc >2013-12-04 05:24:37,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29b0d308 >2013-12-04 05:24:37,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 29b0d308 >2013-12-04 05:24:37,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 211accf2 >2013-12-04 05:24:37,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cf6031f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc1b7fb7}, log id: 211accf2 >2013-12-04 05:24:42,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 724bdbac >2013-12-04 05:24:43,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 724bdbac >2013-12-04 05:24:43,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 254fc4cd >2013-12-04 05:24:43,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2a5f437, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7565539}, log id: 254fc4cd >2013-12-04 05:24:48,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5013b4ed >2013-12-04 05:24:49,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5013b4ed >2013-12-04 05:24:49,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 729463df >2013-12-04 05:24:49,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10b1e5bf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f053f98}, log id: 729463df >2013-12-04 05:24:54,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 41ff77cf >2013-12-04 05:24:55,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41ff77cf >2013-12-04 05:24:55,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6b07629b >2013-12-04 05:24:55,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37e3b70d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be310568}, log id: 6b07629b >2013-12-04 05:25:00,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6694f9f5 >2013-12-04 05:25:00,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6694f9f5 >2013-12-04 05:25:00,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2de65769 >2013-12-04 05:25:01,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3a7220f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@233d89e}, log id: 2de65769 >2013-12-04 05:25:06,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1bc65764 >2013-12-04 05:25:06,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bc65764 >2013-12-04 05:25:06,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2525fc5 >2013-12-04 05:25:06,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d248cc3a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73723463}, log id: 2525fc5 >2013-12-04 05:25:11,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59262145 >2013-12-04 05:25:12,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 59262145 >2013-12-04 05:25:12,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4b32692a >2013-12-04 05:25:12,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75bd012e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44f31df0}, log id: 4b32692a >2013-12-04 05:25:17,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4098b8a >2013-12-04 05:25:18,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4098b8a >2013-12-04 05:25:18,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7deaf4cb >2013-12-04 05:25:18,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3694a594, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cf80897}, log id: 7deaf4cb >2013-12-04 05:25:19,122 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) No up server in cluster >2013-12-04 05:25:19,123 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:25:19,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b726796 >2013-12-04 05:25:19,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, return: [], log id: b726796 >2013-12-04 05:25:23,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c18a71b >2013-12-04 05:25:24,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c18a71b >2013-12-04 05:25:24,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d7e52cf >2013-12-04 05:25:24,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cf4811b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c147d9f1}, log id: 6d7e52cf >2013-12-04 05:25:29,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7a2f7064 >2013-12-04 05:25:29,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a2f7064 >2013-12-04 05:25:29,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6462d1f9 >2013-12-04 05:25:30,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@684c761d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bfbb837}, log id: 6462d1f9 >2013-12-04 05:25:35,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29c7af5c >2013-12-04 05:25:35,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 29c7af5c >2013-12-04 05:25:35,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4a66a447 >2013-12-04 05:25:36,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@525ea39, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4678d9}, log id: 4a66a447 >2013-12-04 05:25:41,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d9b548c >2013-12-04 05:25:41,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d9b548c >2013-12-04 05:25:41,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6d86a176 >2013-12-04 05:25:41,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0a17369, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68b66d07}, log id: 6d86a176 >2013-12-04 05:25:46,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: f2fb76f >2013-12-04 05:25:47,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f2fb76f >2013-12-04 05:25:47,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1eea6f0b >2013-12-04 05:25:47,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3256980, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10715404}, log id: 1eea6f0b >2013-12-04 05:25:52,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 68431e43 >2013-12-04 05:25:53,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 68431e43 >2013-12-04 05:25:53,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41765d45 >2013-12-04 05:25:53,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1bb5821, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af444fb5}, log id: 41765d45 >2013-12-04 05:25:58,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7b56f7c3 >2013-12-04 05:25:59,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7b56f7c3 >2013-12-04 05:25:59,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2616a0b4 >2013-12-04 05:25:59,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfbecfca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a106d5c}, log id: 2616a0b4 >2013-12-04 05:26:04,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: fce5ec9 >2013-12-04 05:26:04,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fce5ec9 >2013-12-04 05:26:04,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 46daa707 >2013-12-04 05:26:05,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24dca712, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41349277}, log id: 46daa707 >2013-12-04 05:26:10,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 780b51fd >2013-12-04 05:26:10,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 780b51fd >2013-12-04 05:26:10,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: a393347 >2013-12-04 05:26:11,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c0cbc28, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cc91468}, log id: a393347 >2013-12-04 05:26:16,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4e4ea38a >2013-12-04 05:26:16,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4e4ea38a >2013-12-04 05:26:16,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46a25b85 >2013-12-04 05:26:16,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cfc28b6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f340931d}, log id: 46a25b85 >2013-12-04 05:26:19,429 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-04 05:26:19,430 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:26:19,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6f2c6dd2 >2013-12-04 05:26:19,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f2c6dd2 >2013-12-04 05:26:21,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6cdc2095 >2013-12-04 05:26:22,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cdc2095 >2013-12-04 05:26:22,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 577c1b71 >2013-12-04 05:26:22,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d677642e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3d22558}, log id: 577c1b71 >2013-12-04 05:26:27,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20aa63a2 >2013-12-04 05:26:28,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 20aa63a2 >2013-12-04 05:26:28,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a3a6f1e >2013-12-04 05:26:28,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@562e6f80, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b38b975}, log id: a3a6f1e >2013-12-04 05:26:33,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9c18cf0 >2013-12-04 05:26:34,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 9c18cf0 >2013-12-04 05:26:34,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2f64cc4c >2013-12-04 05:26:34,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d161760, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdb78de0}, log id: 2f64cc4c >2013-12-04 05:26:39,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6f93a122 >2013-12-04 05:26:39,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f93a122 >2013-12-04 05:26:39,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b52afb2 >2013-12-04 05:26:40,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0777823, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ec0c1af}, log id: 1b52afb2 >2013-12-04 05:26:45,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ee5d3ec >2013-12-04 05:26:45,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ee5d3ec >2013-12-04 05:26:45,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: c5c7044 >2013-12-04 05:26:45,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77440352, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baa79160}, log id: c5c7044 >2013-12-04 05:26:51,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f602a77 >2013-12-04 05:26:51,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5f602a77 >2013-12-04 05:26:51,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39f334bb >2013-12-04 05:26:51,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c572529f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b286004}, log id: 39f334bb >2013-12-04 05:26:56,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 33320ce1 >2013-12-04 05:26:57,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 33320ce1 >2013-12-04 05:26:57,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2ac70758 >2013-12-04 05:26:57,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e457ee49, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bdc0e89}, log id: 2ac70758 >2013-12-04 05:27:02,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 736473fc >2013-12-04 05:27:03,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 736473fc >2013-12-04 05:27:03,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 51ab9633 >2013-12-04 05:27:03,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4026ce02, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c22ce97}, log id: 51ab9633 >2013-12-04 05:27:08,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e4ed00b >2013-12-04 05:27:09,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e4ed00b >2013-12-04 05:27:09,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f9d568a >2013-12-04 05:27:09,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@360219b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd767489}, log id: 1f9d568a >2013-12-04 05:27:14,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4db3bb93 >2013-12-04 05:27:14,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4db3bb93 >2013-12-04 05:27:14,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 411cdeec >2013-12-04 05:27:15,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5732bb4f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af90beee}, log id: 411cdeec >2013-12-04 05:27:19,770 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-04 05:27:19,771 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:27:19,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ef4e020 >2013-12-04 05:27:20,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4ef4e020 >2013-12-04 05:27:20,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7effce9 >2013-12-04 05:27:20,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7effce9 >2013-12-04 05:27:20,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b5b5e66 >2013-12-04 05:27:20,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6af722f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b8fe7b1}, log id: 3b5b5e66 >2013-12-04 05:27:25,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 467e9bd4 >2013-12-04 05:27:26,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 467e9bd4 >2013-12-04 05:27:26,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3cf9fffa >2013-12-04 05:27:26,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99f4e6b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95763c63}, log id: 3cf9fffa >2013-12-04 05:27:31,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 55f87144 >2013-12-04 05:27:32,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 55f87144 >2013-12-04 05:27:32,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d7db7b5 >2013-12-04 05:27:32,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63ebaf55, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@966a515e}, log id: d7db7b5 >2013-12-04 05:27:37,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 36ceb17 >2013-12-04 05:27:38,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36ceb17 >2013-12-04 05:27:38,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6fef6f81 >2013-12-04 05:27:38,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78fcf11c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@527fb774}, log id: 6fef6f81 >2013-12-04 05:27:43,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7bcfecb >2013-12-04 05:27:43,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7bcfecb >2013-12-04 05:27:43,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 735488a >2013-12-04 05:27:44,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52b61dfa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ef07ce3}, log id: 735488a >2013-12-04 05:27:49,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f07fce6 >2013-12-04 05:27:49,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f07fce6 >2013-12-04 05:27:49,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7c577de7 >2013-12-04 05:27:50,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69332ea0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3de96170}, log id: 7c577de7 >2013-12-04 05:27:55,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7fec0cfb >2013-12-04 05:27:55,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7fec0cfb >2013-12-04 05:27:55,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5404a379 >2013-12-04 05:27:55,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b15bacb3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@735fb00f}, log id: 5404a379 >2013-12-04 05:28:00,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3da34675 >2013-12-04 05:28:01,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3da34675 >2013-12-04 05:28:01,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d050ae8 >2013-12-04 05:28:01,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2755994c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcc7a0a3}, log id: d050ae8 >2013-12-04 05:28:06,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 776fc215 >2013-12-04 05:28:07,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 776fc215 >2013-12-04 05:28:07,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6d9a021 >2013-12-04 05:28:07,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7c2d296, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5ac8a01}, log id: 6d9a021 >2013-12-04 05:28:12,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2f026dd4 >2013-12-04 05:28:13,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2f026dd4 >2013-12-04 05:28:13,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f58f859 >2013-12-04 05:28:13,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22d7428d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9b0d6e1}, log id: 4f58f859 >2013-12-04 05:28:18,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47407d4f >2013-12-04 05:28:18,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 47407d4f >2013-12-04 05:28:18,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6521a436 >2013-12-04 05:28:19,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d00ad42, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5172a7b2}, log id: 6521a436 >2013-12-04 05:28:20,094 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-04 05:28:20,095 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:28:20,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1d39059c >2013-12-04 05:28:20,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1d39059c >2013-12-04 05:28:24,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 496d8ad5 >2013-12-04 05:28:24,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 496d8ad5 >2013-12-04 05:28:24,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 396c328 >2013-12-04 05:28:25,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d251ce7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f3b618f}, log id: 396c328 >2013-12-04 05:28:30,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50154b21 >2013-12-04 05:28:30,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 50154b21 >2013-12-04 05:28:30,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 304b872b >2013-12-04 05:28:30,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d155acd3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99b700b3}, log id: 304b872b >2013-12-04 05:28:35,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 660b73f6 >2013-12-04 05:28:36,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 660b73f6 >2013-12-04 05:28:36,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4145ee61 >2013-12-04 05:28:36,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ebd62f1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ea24f1d}, log id: 4145ee61 >2013-12-04 05:28:41,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 30634b1a >2013-12-04 05:28:42,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 30634b1a >2013-12-04 05:28:42,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 65422904 >2013-12-04 05:28:42,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15cf8d04, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c68ac13}, log id: 65422904 >2013-12-04 05:28:47,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b44110b >2013-12-04 05:28:48,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b44110b >2013-12-04 05:28:48,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 56b08d22 >2013-12-04 05:28:48,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8a156c8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8af2d4f8}, log id: 56b08d22 >2013-12-04 05:28:53,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 998dfa4 >2013-12-04 05:28:53,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 998dfa4 >2013-12-04 05:28:53,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66d9aba3 >2013-12-04 05:28:54,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f167d4e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b06eaec}, log id: 66d9aba3 >2013-12-04 05:28:59,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 20473a70 >2013-12-04 05:28:59,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20473a70 >2013-12-04 05:28:59,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7d930c5d >2013-12-04 05:28:59,828 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-91) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:28:59,918 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-91) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:28:59,937 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-91) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:28:59,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d01a7996, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81abb329}, log id: 7d930c5d >2013-12-04 05:28:59,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5291418f >2013-12-04 05:29:00,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@fe0a9c5, log id: 5291418f >2013-12-04 05:29:00,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66a9cca7 >2013-12-04 05:29:00,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@57cf310c, log id: 66a9cca7 >2013-12-04 05:29:05,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 23540dcf >2013-12-04 05:29:05,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 23540dcf >2013-12-04 05:29:05,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3459ccf5 >2013-12-04 05:29:05,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41370b9c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93cbcc1e}, log id: 3459ccf5 >2013-12-04 05:29:10,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5c054188 >2013-12-04 05:29:11,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c054188 >2013-12-04 05:29:11,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5cc2af81 >2013-12-04 05:29:11,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5214b43b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c24d3c8}, log id: 5cc2af81 >2013-12-04 05:29:16,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: ca95674 >2013-12-04 05:29:17,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: ca95674 >2013-12-04 05:29:17,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 37c39c7d >2013-12-04 05:29:17,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5896147d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@464a2832}, log id: 37c39c7d >2013-12-04 05:29:20,391 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) No up server in cluster >2013-12-04 05:29:20,392 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:29:20,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 464dd0da >2013-12-04 05:29:20,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterTasksListVDSCommand, return: [], log id: 464dd0da >2013-12-04 05:29:22,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d26bc65 >2013-12-04 05:29:22,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d26bc65 >2013-12-04 05:29:22,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: c0014aa >2013-12-04 05:29:23,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd14228b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d9e1052}, log id: c0014aa >2013-12-04 05:29:28,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4cc8b5a2 >2013-12-04 05:29:28,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4cc8b5a2 >2013-12-04 05:29:28,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5611c75e >2013-12-04 05:29:28,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1c3b4a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@569a3744}, log id: 5611c75e >2013-12-04 05:29:34,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54f5e8f >2013-12-04 05:29:34,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 54f5e8f >2013-12-04 05:29:34,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5657acdd >2013-12-04 05:29:34,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e99e8e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e66d5b6}, log id: 5657acdd >2013-12-04 05:29:39,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 11514bec >2013-12-04 05:29:40,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11514bec >2013-12-04 05:29:40,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5db4c5b1 >2013-12-04 05:29:40,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de80cb12, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6fc38dd}, log id: 5db4c5b1 >2013-12-04 05:29:45,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e7686ef >2013-12-04 05:29:46,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: e7686ef >2013-12-04 05:29:46,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39e40022 >2013-12-04 05:29:46,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f01db23, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8430ab8}, log id: 39e40022 >2013-12-04 05:29:51,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7cb5f74a >2013-12-04 05:29:52,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7cb5f74a >2013-12-04 05:29:52,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 390314d3 >2013-12-04 05:29:52,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c66d57c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35cfece9}, log id: 390314d3 >2013-12-04 05:29:57,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5b8c0566 >2013-12-04 05:29:57,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b8c0566 >2013-12-04 05:29:57,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 65902ac >2013-12-04 05:29:58,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7359a53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ceb2d528}, log id: 65902ac >2013-12-04 05:30:03,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 8561c30 >2013-12-04 05:30:03,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8561c30 >2013-12-04 05:30:03,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1d75651c >2013-12-04 05:30:03,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4de76b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9096fb74}, log id: 1d75651c >2013-12-04 05:30:08,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 36a2e1b2 >2013-12-04 05:30:09,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36a2e1b2 >2013-12-04 05:30:09,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 74de3275 >2013-12-04 05:30:09,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8c73513, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaef7ab3}, log id: 74de3275 >2013-12-04 05:30:14,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 57045c1b >2013-12-04 05:30:15,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57045c1b >2013-12-04 05:30:15,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 37a91849 >2013-12-04 05:30:15,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7be30fa2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87da5af6}, log id: 37a91849 >2013-12-04 05:30:20,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 48793ad3 >2013-12-04 05:30:20,716 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-04 05:30:20,716 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:30:20,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4fdddbe5 >2013-12-04 05:30:21,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4fdddbe5 >2013-12-04 05:30:21,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 48793ad3 >2013-12-04 05:30:21,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 737f1e4b >2013-12-04 05:30:21,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a16e3cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b227aa5}, log id: 737f1e4b >2013-12-04 05:30:26,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 77c3b960 >2013-12-04 05:30:26,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 77c3b960 >2013-12-04 05:30:26,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63d48e5 >2013-12-04 05:30:27,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce791c08, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15402880}, log id: 63d48e5 >2013-12-04 05:30:32,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a22bce >2013-12-04 05:30:32,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a22bce >2013-12-04 05:30:32,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b1b7542 >2013-12-04 05:30:33,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad7e448, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e19a448}, log id: 5b1b7542 >2013-12-04 05:30:38,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b86a57f >2013-12-04 05:30:38,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b86a57f >2013-12-04 05:30:38,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 274086c5 >2013-12-04 05:30:38,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@192a1e4d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bea9165}, log id: 274086c5 >2013-12-04 05:30:43,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 55296eeb >2013-12-04 05:30:44,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 55296eeb >2013-12-04 05:30:44,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 258b4eda >2013-12-04 05:30:44,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eece0f32, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36f9fc63}, log id: 258b4eda >2013-12-04 05:30:49,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 64241072 >2013-12-04 05:30:50,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 64241072 >2013-12-04 05:30:50,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a7379cf >2013-12-04 05:30:50,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de1aa0d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c2bacb3}, log id: 5a7379cf >2013-12-04 05:30:55,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: a2b9c10 >2013-12-04 05:30:56,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: a2b9c10 >2013-12-04 05:30:56,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 665940c3 >2013-12-04 05:30:56,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@970c6169, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20c9607c}, log id: 665940c3 >2013-12-04 05:31:01,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 395b14f1 >2013-12-04 05:31:01,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 395b14f1 >2013-12-04 05:31:01,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a0364d2 >2013-12-04 05:31:02,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fe9db78, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d6efde7}, log id: 1a0364d2 >2013-12-04 05:31:07,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 55c98748 >2013-12-04 05:31:07,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 55c98748 >2013-12-04 05:31:07,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 555af54f >2013-12-04 05:31:07,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@427f8698, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1c8bf5d}, log id: 555af54f >2013-12-04 05:31:08,906 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-7) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 05:31:12,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5032733d >2013-12-04 05:31:13,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5032733d >2013-12-04 05:31:13,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 564bef37 >2013-12-04 05:31:13,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44710d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31bd9e17}, log id: 564bef37 >2013-12-04 05:31:18,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1b53cc81 >2013-12-04 05:31:19,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b53cc81 >2013-12-04 05:31:19,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 594f5277 >2013-12-04 05:31:19,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82da412a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7056cba7}, log id: 594f5277 >2013-12-04 05:31:21,012 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) No up server in cluster >2013-12-04 05:31:21,012 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:31:21,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 528ad760 >2013-12-04 05:31:21,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, return: [], log id: 528ad760 >2013-12-04 05:31:24,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 60330555 >2013-12-04 05:31:25,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60330555 >2013-12-04 05:31:25,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5a7125a8 >2013-12-04 05:31:25,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57b09e56, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@143c9c8f}, log id: 5a7125a8 >2013-12-04 05:31:30,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4dc857e0 >2013-12-04 05:31:30,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4dc857e0 >2013-12-04 05:31:30,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 54d99b7c >2013-12-04 05:31:31,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae73ec2f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9bd95a5}, log id: 54d99b7c >2013-12-04 05:31:36,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2f17939a >2013-12-04 05:31:36,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f17939a >2013-12-04 05:31:36,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 26a497 >2013-12-04 05:31:37,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92a0697c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22ea07be}, log id: 26a497 >2013-12-04 05:31:42,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f461760 >2013-12-04 05:31:42,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f461760 >2013-12-04 05:31:42,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 10056c3 >2013-12-04 05:31:42,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e42cf0d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fecd2de}, log id: 10056c3 >2013-12-04 05:31:47,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2bbd8f60 >2013-12-04 05:31:48,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bbd8f60 >2013-12-04 05:31:48,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f4f7dec >2013-12-04 05:31:48,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32b9e80b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14a128b1}, log id: f4f7dec >2013-12-04 05:31:50,755 INFO [org.ovirt.engine.core.bll.gluster.AddBricksToGlusterVolumeCommand] (ajp-/127.0.0.1:8702-11) [52530d41] Running command: AddBricksToGlusterVolumeCommand internal: false. Entities affected : ID: be2c16f2-a173-4bac-a979-47cf211a97e3 Type: GlusterVolume >2013-12-04 05:31:50,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.AddBricksToGlusterVolumeVDSCommand] (ajp-/127.0.0.1:8702-11) [52530d41] START, AddBricksToGlusterVolumeVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ad58394 >2013-12-04 05:31:53,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.AddBricksToGlusterVolumeVDSCommand] (ajp-/127.0.0.1:8702-11) [52530d41] FINISH, AddBricksToGlusterVolumeVDSCommand, log id: ad58394 >2013-12-04 05:31:53,683 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [52530d41] No severity for GLUSTER_VOLUME_BRICK_ADDED audit log type, assuming Normal severity >2013-12-04 05:31:53,691 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [52530d41] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Brick [/rhs/brick1/b1] on host [10.70.37.74] added to volume [dis_vol] >2013-12-04 05:31:53,714 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-62) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:31:53,717 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [52530d41] Correlation ID: 52530d41, Job ID: 4da44165-d58a-4e94-a364-0e086d79060b, Call Stack: null, Custom Event ID: -1, Message: 1 brick(s) added to volume dis_vol. >2013-12-04 05:31:53,721 INFO [org.ovirt.engine.core.bll.gluster.AddBricksToGlusterVolumeCommand] (ajp-/127.0.0.1:8702-11) [52530d41] Lock freed to object EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:31:53,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5843a1c2 >2013-12-04 05:31:54,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5843a1c2 >2013-12-04 05:31:54,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3220a564 >2013-12-04 05:31:54,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78e77bd5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2185b406}, log id: 3220a564 >2013-12-04 05:31:59,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3ce81390 >2013-12-04 05:32:00,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ce81390 >2013-12-04 05:32:00,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7acb0d3 >2013-12-04 05:32:00,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40cd857d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4d8d237}, log id: 7acb0d3 >2013-12-04 05:32:05,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1bbf2a2a >2013-12-04 05:32:05,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bbf2a2a >2013-12-04 05:32:05,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 493f6ca2 >2013-12-04 05:32:06,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1be8c4d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4d6659f}, log id: 493f6ca2 >2013-12-04 05:32:08,076 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-15) [26633ecb] Lock Acquired to object EngineLock [exclusiveLocks= key: be2c16f2-a173-4bac-a979-47cf211a97e3 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:32:08,089 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-15) [26633ecb] Running command: StartRemoveGlusterVolumeBricksCommand internal: false. Entities affected : ID: be2c16f2-a173-4bac-a979-47cf211a97e3 Type: GlusterVolume >2013-12-04 05:32:08,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-15) [26633ecb] START, StartRemoveGlusterVolumeBricksVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 71e62ed4 >2013-12-04 05:32:11,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 65cfe999 >2013-12-04 05:32:11,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 65cfe999 >2013-12-04 05:32:11,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3bb9ab3a >2013-12-04 05:32:12,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c5adfea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5552c14}, log id: 3bb9ab3a >2013-12-04 05:32:15,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-15) [26633ecb] FINISH, StartRemoveGlusterVolumeBricksVDSCommand, return: org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@a9f6f792, log id: 71e62ed4 >2013-12-04 05:32:15,216 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [26633ecb] Correlation ID: 26633ecb, Job ID: e26a0b06-c846-4799-a318-57cc329fb2b7, Call Stack: null, Custom Event ID: -1, Message: Started removing bricks from Volume dis_vol >2013-12-04 05:32:17,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 243dec95 >2013-12-04 05:32:17,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 243dec95 >2013-12-04 05:32:17,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 14a3dbbd >2013-12-04 05:32:17,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@947428d1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d10160a}, log id: 14a3dbbd >2013-12-04 05:32:21,326 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) [6dd5dead] No up server in cluster >2013-12-04 05:32:21,340 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) [6dd5dead] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:32:21,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 51fa4585 >2013-12-04 05:32:22,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@21d245ba], log id: 51fa4585 >2013-12-04 05:32:22,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c8678e3 >2013-12-04 05:32:23,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c8678e3 >2013-12-04 05:32:23,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56b90154 >2013-12-04 05:32:23,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3134c8f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@484e4eab}, log id: 56b90154 >2013-12-04 05:32:25,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c5aaf34 >2013-12-04 05:32:25,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@5ebbb3be, log id: 4c5aaf34 >2013-12-04 05:32:28,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4ace1ca0 >2013-12-04 05:32:29,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ace1ca0 >2013-12-04 05:32:29,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: d1d47c9 >2013-12-04 05:32:29,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6788ab7c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4acfb5ea}, log id: d1d47c9 >2013-12-04 05:32:34,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 34438887 >2013-12-04 05:32:35,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34438887 >2013-12-04 05:32:35,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5e779cb0 >2013-12-04 05:32:35,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-8) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 61dfc040 >2013-12-04 05:32:35,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efd00072, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55e9400c}, log id: 5e779cb0 >2013-12-04 05:32:35,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-8) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@4d705d89, log id: 61dfc040 >2013-12-04 05:32:40,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67ec16d1 >2013-12-04 05:32:41,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 67ec16d1 >2013-12-04 05:32:41,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f71e731 >2013-12-04 05:32:41,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d55db1cb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8a6cc2f}, log id: 3f71e731 >2013-12-04 05:32:45,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-15) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17216ee0 >2013-12-04 05:32:45,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-15) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@6a6f2c9c, log id: 17216ee0 >2013-12-04 05:32:46,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2be88246 >2013-12-04 05:32:47,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2be88246 >2013-12-04 05:32:47,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 35cfd04a >2013-12-04 05:32:47,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf403d72, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cda7f3a9}, log id: 35cfd04a >2013-12-04 05:32:52,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2c809056 >2013-12-04 05:32:53,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c809056 >2013-12-04 05:32:53,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 832cc6b >2013-12-04 05:32:53,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c350f509, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a104cb68}, log id: 832cc6b >2013-12-04 05:32:55,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-16) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a8fda39 >2013-12-04 05:32:55,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-16) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@39e01eeb, log id: 6a8fda39 >2013-12-04 05:32:58,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1163e0ea >2013-12-04 05:32:58,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1163e0ea >2013-12-04 05:32:58,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 18d5e4bc >2013-12-04 05:32:59,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43068564, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f83af7b7}, log id: 18d5e4bc >2013-12-04 05:33:04,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37e69d9d >2013-12-04 05:33:04,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 37e69d9d >2013-12-04 05:33:04,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73700a3a >2013-12-04 05:33:05,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bda5cb64, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@495faef9}, log id: 73700a3a >2013-12-04 05:33:05,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-7) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d952e44 >2013-12-04 05:33:05,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-7) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@6f39eb52, log id: 6d952e44 >2013-12-04 05:33:10,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 147aa93 >2013-12-04 05:33:10,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 147aa93 >2013-12-04 05:33:10,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 777ef7f1 >2013-12-04 05:33:10,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@531d6f7c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dcfed1b}, log id: 777ef7f1 >2013-12-04 05:33:15,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-3) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 65f4f8a6 >2013-12-04 05:33:15,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-3) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@4a3cac57, log id: 65f4f8a6 >2013-12-04 05:33:15,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7c04efcb >2013-12-04 05:33:16,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7c04efcb >2013-12-04 05:33:16,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 480a05bd >2013-12-04 05:33:16,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0416679, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f033f6c}, log id: 480a05bd >2013-12-04 05:33:21,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 23608c1a >2013-12-04 05:33:22,049 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) No up server in cluster >2013-12-04 05:33:22,049 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:33:22,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57470790 >2013-12-04 05:33:22,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23608c1a >2013-12-04 05:33:22,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1ad30a7b >2013-12-04 05:33:22,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@28ad7244], log id: 57470790 >2013-12-04 05:33:22,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@654ae2a6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cebaa6d2}, log id: 1ad30a7b >2013-12-04 05:33:25,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-6) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4f1d96ac >2013-12-04 05:33:25,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-6) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@266a33a2, log id: 4f1d96ac >2013-12-04 05:33:27,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a627eb3 >2013-12-04 05:33:28,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: a627eb3 >2013-12-04 05:33:28,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 253f7c5f >2013-12-04 05:33:28,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82a409b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30b72e76}, log id: 253f7c5f >2013-12-04 05:33:33,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 44f02cc6 >2013-12-04 05:33:34,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 44f02cc6 >2013-12-04 05:33:34,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 73d09270 >2013-12-04 05:33:34,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@288656a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@663f1011}, log id: 73d09270 >2013-12-04 05:33:35,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: bbb6411 >2013-12-04 05:33:36,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@5cad1504, log id: bbb6411 >2013-12-04 05:33:39,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5dfc48bc >2013-12-04 05:33:39,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5dfc48bc >2013-12-04 05:33:39,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6244283c >2013-12-04 05:33:40,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20dd3fd1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82a5e310}, log id: 6244283c >2013-12-04 05:33:45,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 796ea666 >2013-12-04 05:33:45,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-9) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 233de10d >2013-12-04 05:33:45,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 796ea666 >2013-12-04 05:33:45,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4e1a247d >2013-12-04 05:33:45,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-9) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@32e51bd7, log id: 233de10d >2013-12-04 05:33:46,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2fa66b1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fab990}, log id: 4e1a247d >2013-12-04 05:33:51,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1b75777a >2013-12-04 05:33:51,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b75777a >2013-12-04 05:33:51,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7a25b874 >2013-12-04 05:33:51,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8eca978, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b10fc2b}, log id: 7a25b874 >2013-12-04 05:33:55,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 12100236 >2013-12-04 05:33:55,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@26872b1d, log id: 12100236 >2013-12-04 05:33:56,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 491db089 >2013-12-04 05:33:57,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 491db089 >2013-12-04 05:33:57,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24931494 >2013-12-04 05:33:57,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@367cd6cb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de484c6c}, log id: 24931494 >2013-12-04 05:34:00,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f125c5 >2013-12-04 05:34:00,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@76d8e08c, log id: 1f125c5 >2013-12-04 05:34:00,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 187e4449 >2013-12-04 05:34:01,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6bb84690, log id: 187e4449 >2013-12-04 05:34:02,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: b89f7e3 >2013-12-04 05:34:03,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b89f7e3 >2013-12-04 05:34:03,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2c784d27 >2013-12-04 05:34:03,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41653cf7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90ee49d9}, log id: 2c784d27 >2013-12-04 05:34:05,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2238f45a >2013-12-04 05:34:05,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@61fa1c49, log id: 2238f45a >2013-12-04 05:34:08,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69fe8e5 >2013-12-04 05:34:09,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 69fe8e5 >2013-12-04 05:34:09,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 44f60f01 >2013-12-04 05:34:09,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@110c7161, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@919dca0c}, log id: 44f60f01 >2013-12-04 05:34:14,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a572b5b >2013-12-04 05:34:15,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: a572b5b >2013-12-04 05:34:15,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 121132ef >2013-12-04 05:34:15,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e860c55, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f780373}, log id: 121132ef >2013-12-04 05:34:15,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-8) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3415053e >2013-12-04 05:34:16,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-8) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@71f4486, log id: 3415053e >2013-12-04 05:34:20,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f45e5f8 >2013-12-04 05:34:20,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3f45e5f8 >2013-12-04 05:34:20,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2ab316e8 >2013-12-04 05:34:21,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f499dfb0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e75a312}, log id: 2ab316e8 >2013-12-04 05:34:22,604 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-04 05:34:22,604 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:34:22,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 77317de9 >2013-12-04 05:34:23,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@ad48b7c], log id: 77317de9 >2013-12-04 05:34:25,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-15) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40f4f5de >2013-12-04 05:34:25,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-15) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@69278251, log id: 40f4f5de >2013-12-04 05:34:26,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1d89c32d >2013-12-04 05:34:26,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d89c32d >2013-12-04 05:34:26,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6fec512c >2013-12-04 05:34:27,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1965d296, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@406af69e}, log id: 6fec512c >2013-12-04 05:34:32,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 28ba64df >2013-12-04 05:34:32,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 28ba64df >2013-12-04 05:34:32,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 167bf777 >2013-12-04 05:34:33,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b057a77, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26657904}, log id: 167bf777 >2013-12-04 05:34:35,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7c52f6e0 >2013-12-04 05:34:36,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@73b7dae6, log id: 7c52f6e0 >2013-12-04 05:34:38,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 683d0103 >2013-12-04 05:34:38,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 683d0103 >2013-12-04 05:34:38,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22626201 >2013-12-04 05:34:38,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3ff7d07, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@762367d4}, log id: 22626201 >2013-12-04 05:34:43,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 480c6e04 >2013-12-04 05:34:44,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 480c6e04 >2013-12-04 05:34:44,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 371b9ead >2013-12-04 05:34:44,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8c59f6a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7575a0}, log id: 371b9ead >2013-12-04 05:34:45,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-6) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d2b0439 >2013-12-04 05:34:46,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-6) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@5c3514f8, log id: 5d2b0439 >2013-12-04 05:34:49,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a03dc74 >2013-12-04 05:34:50,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a03dc74 >2013-12-04 05:34:50,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 704dab58 >2013-12-04 05:34:50,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94d440d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47dd3cc0}, log id: 704dab58 >2013-12-04 05:34:55,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 500d4b5a >2013-12-04 05:34:55,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-1) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 494271ea >2013-12-04 05:34:56,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-1) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@6b3c134c, log id: 494271ea >2013-12-04 05:34:56,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 500d4b5a >2013-12-04 05:34:56,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f7bee9f >2013-12-04 05:34:56,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28d91671, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3258505c}, log id: 4f7bee9f >2013-12-04 05:35:01,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 403f00a3 >2013-12-04 05:35:02,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 403f00a3 >2013-12-04 05:35:02,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2aa3beea >2013-12-04 05:35:02,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cbae985, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41db9c1a}, log id: 2aa3beea >2013-12-04 05:35:05,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-11) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5dac8e07 >2013-12-04 05:35:06,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-11) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@28662e5c, log id: 5dac8e07 >2013-12-04 05:35:07,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4ccada06 >2013-12-04 05:35:07,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ccada06 >2013-12-04 05:35:07,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 57bef33d >2013-12-04 05:35:08,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca745c2a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5c9fff9}, log id: 57bef33d >2013-12-04 05:35:13,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: acdb81a >2013-12-04 05:35:13,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: acdb81a >2013-12-04 05:35:13,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1c849458 >2013-12-04 05:35:13,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca9f8153, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ade86252}, log id: 1c849458 >2013-12-04 05:35:15,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-16) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 21f64d03 >2013-12-04 05:35:16,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-16) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@49a22cdc, log id: 21f64d03 >2013-12-04 05:35:19,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a892e3f >2013-12-04 05:35:19,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a892e3f >2013-12-04 05:35:19,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 76d68097 >2013-12-04 05:35:19,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c030bd3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d6f3966}, log id: 76d68097 >2013-12-04 05:35:23,241 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) No up server in cluster >2013-12-04 05:35:23,248 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:35:23,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 662d796f >2013-12-04 05:35:23,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@446fb954], log id: 662d796f >2013-12-04 05:35:24,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b2e9bce >2013-12-04 05:35:25,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: b2e9bce >2013-12-04 05:35:25,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ab76d45 >2013-12-04 05:35:25,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec7ac37a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27f792c7}, log id: 3ab76d45 >2013-12-04 05:35:25,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 424a61d9 >2013-12-04 05:35:26,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@7d5b4e4b, log id: 424a61d9 >2013-12-04 05:35:30,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f0267e >2013-12-04 05:35:31,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f0267e >2013-12-04 05:35:31,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 46a17e >2013-12-04 05:35:31,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1066f20d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cab133d4}, log id: 46a17e >2013-12-04 05:35:35,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-5) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 35fbb01d >2013-12-04 05:35:36,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-5) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@5a6471e0, log id: 35fbb01d >2013-12-04 05:35:36,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63b2f5bd >2013-12-04 05:35:37,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 63b2f5bd >2013-12-04 05:35:37,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4fce100 >2013-12-04 05:35:37,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a3a831f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0f3da10}, log id: 4fce100 >2013-12-04 05:35:42,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c611b97 >2013-12-04 05:35:42,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c611b97 >2013-12-04 05:35:42,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d7f19b0 >2013-12-04 05:35:43,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7cc0fce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@286462f2}, log id: 5d7f19b0 >2013-12-04 05:35:45,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f4379aa >2013-12-04 05:35:46,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@75e814ac, log id: f4379aa >2013-12-04 05:35:48,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6320f2ea >2013-12-04 05:35:48,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6320f2ea >2013-12-04 05:35:48,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 15148ab5 >2013-12-04 05:35:48,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f86f28a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfb1c7f}, log id: 15148ab5 >2013-12-04 05:35:54,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 65d5dee5 >2013-12-04 05:35:54,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65d5dee5 >2013-12-04 05:35:54,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 38cd42a8 >2013-12-04 05:35:54,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d674681f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8acb667}, log id: 38cd42a8 >2013-12-04 05:35:55,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 722a715a >2013-12-04 05:35:56,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@331b6e4d, log id: 722a715a >2013-12-04 05:35:59,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41b93be >2013-12-04 05:36:00,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 41b93be >2013-12-04 05:36:00,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 107d08b >2013-12-04 05:36:00,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fd7e2c4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d527305}, log id: 107d08b >2013-12-04 05:36:05,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1f8adf98 >2013-12-04 05:36:05,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 699be970 >2013-12-04 05:36:06,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@3bbf73fb, log id: 1f8adf98 >2013-12-04 05:36:06,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 699be970 >2013-12-04 05:36:06,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f1ab972 >2013-12-04 05:36:06,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35449923, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e962c99}, log id: 5f1ab972 >2013-12-04 05:36:11,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 25bd3716 >2013-12-04 05:36:12,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 25bd3716 >2013-12-04 05:36:12,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5887f757 >2013-12-04 05:36:12,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f1289a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@208eed3a}, log id: 5887f757 >2013-12-04 05:36:15,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-3) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6fb15256 >2013-12-04 05:36:16,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-3) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@311e546b, log id: 6fb15256 >2013-12-04 05:36:17,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46afa36e >2013-12-04 05:36:18,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 46afa36e >2013-12-04 05:36:18,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 464c0d48 >2013-12-04 05:36:18,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a326a0c4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c90df219}, log id: 464c0d48 >2013-12-04 05:36:23,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c5db046 >2013-12-04 05:36:23,867 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-04 05:36:23,867 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:36:23,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f7b8f6a >2013-12-04 05:36:23,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c5db046 >2013-12-04 05:36:23,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: bb3b607 >2013-12-04 05:36:24,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f42c2bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@889f3e06}, log id: bb3b607 >2013-12-04 05:36:24,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@604bc106], log id: 3f7b8f6a >2013-12-04 05:36:25,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 8eaed3 >2013-12-04 05:36:26,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@179b268, log id: 8eaed3 >2013-12-04 05:36:29,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8c6cb82 >2013-12-04 05:36:29,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 8c6cb82 >2013-12-04 05:36:29,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ae02a0d >2013-12-04 05:36:30,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5f2da25, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a0cc74}, log id: 2ae02a0d >2013-12-04 05:36:35,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d849dc0 >2013-12-04 05:36:35,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d849dc0 >2013-12-04 05:36:35,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 78bb0f85 >2013-12-04 05:36:35,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4c6b6f63 >2013-12-04 05:36:35,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ce4353d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2276daeb}, log id: 78bb0f85 >2013-12-04 05:36:36,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@503706f0, log id: 4c6b6f63 >2013-12-04 05:36:40,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 182bc21c >2013-12-04 05:36:41,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 182bc21c >2013-12-04 05:36:41,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c026177 >2013-12-04 05:36:41,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@592b6013, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4a2fd3}, log id: 3c026177 >2013-12-04 05:36:46,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3e0e78e8 >2013-12-04 05:36:47,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e0e78e8 >2013-12-04 05:36:47,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5d126d80 >2013-12-04 05:36:47,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24e352d2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21e31283}, log id: 5d126d80 >2013-12-04 05:36:52,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 702ba14f >2013-12-04 05:36:53,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 702ba14f >2013-12-04 05:36:53,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 8519fc4 >2013-12-04 05:36:53,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@605c8df5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fe4e5c7}, log id: 8519fc4 >2013-12-04 05:36:58,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25ac0331 >2013-12-04 05:36:58,712 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-3) [446607e0] Running command: LogoutUserCommand internal: false. >2013-12-04 05:36:58,732 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-7) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 05:36:58,763 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [446607e0] Correlation ID: 446607e0, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2013-12-04 05:36:59,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 25ac0331 >2013-12-04 05:36:59,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 580ec69b >2013-12-04 05:36:59,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@686c9102, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55bc9712}, log id: 580ec69b >2013-12-04 05:37:01,294 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-10) Running command: LoginAdminUserCommand internal: false. >2013-12-04 05:37:01,352 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2013-12-04 05:37:04,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36e51d52 >2013-12-04 05:37:04,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 36e51d52 >2013-12-04 05:37:04,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fb1585c >2013-12-04 05:37:05,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0219e43, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4590d83b}, log id: 2fb1585c >2013-12-04 05:37:09,367 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-4) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 05:37:10,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6aa6e27c >2013-12-04 05:37:10,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6aa6e27c >2013-12-04 05:37:10,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67385698 >2013-12-04 05:37:11,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aac7bd84, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba53cc9d}, log id: 67385698 >2013-12-04 05:37:16,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4739dfc1 >2013-12-04 05:37:16,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4739dfc1 >2013-12-04 05:37:16,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 40ea8251 >2013-12-04 05:37:16,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2906dfb2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11611ac}, log id: 40ea8251 >2013-12-04 05:37:17,244 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 05:37:22,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 241ca463 >2013-12-04 05:37:22,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 241ca463 >2013-12-04 05:37:22,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 743c799d >2013-12-04 05:37:22,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d35006a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@249cd94c}, log id: 743c799d >2013-12-04 05:37:24,462 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-38) No up server in cluster >2013-12-04 05:37:24,464 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-38) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:37:24,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c31be12 >2013-12-04 05:37:25,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@1d2fdf58], log id: 6c31be12 >2013-12-04 05:37:27,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1c830364 >2013-12-04 05:37:28,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1c830364 >2013-12-04 05:37:28,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6ad7aec >2013-12-04 05:37:28,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b1ec53c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4670495}, log id: 6ad7aec >2013-12-04 05:37:33,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-3) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6fdcff1a >2013-12-04 05:37:33,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 112847ba >2013-12-04 05:37:33,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-3) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@2d787293, log id: 6fdcff1a >2013-12-04 05:37:34,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 112847ba >2013-12-04 05:37:34,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3abd80f5 >2013-12-04 05:37:34,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70e24d56, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfcbc77f}, log id: 3abd80f5 >2013-12-04 05:37:39,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 507cfede >2013-12-04 05:37:40,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 507cfede >2013-12-04 05:37:40,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 68321240 >2013-12-04 05:37:40,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25648ea4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fe8e801}, log id: 68321240 >2013-12-04 05:37:44,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b568a00 >2013-12-04 05:37:44,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@3728aba2, log id: 1b568a00 >2013-12-04 05:37:45,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 35395d3 >2013-12-04 05:37:45,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35395d3 >2013-12-04 05:37:45,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4151fb6e >2013-12-04 05:37:46,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97e3ea17, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3753986f}, log id: 4151fb6e >2013-12-04 05:37:51,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 339eeb3e >2013-12-04 05:37:52,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 339eeb3e >2013-12-04 05:37:52,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a052971 >2013-12-04 05:37:52,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9e8c7ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d9646c4}, log id: 7a052971 >2013-12-04 05:37:57,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 38773df >2013-12-04 05:37:57,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38773df >2013-12-04 05:37:57,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 43b7a0d3 >2013-12-04 05:37:58,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c2411c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e41e05db}, log id: 43b7a0d3 >2013-12-04 05:38:03,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ac96268 >2013-12-04 05:38:03,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: ac96268 >2013-12-04 05:38:03,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1517f4de >2013-12-04 05:38:04,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98b2c32c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfff7411}, log id: 1517f4de >2013-12-04 05:38:09,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 37bc9a4 >2013-12-04 05:38:09,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37bc9a4 >2013-12-04 05:38:09,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7ea76d27 >2013-12-04 05:38:09,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76cdc4a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a271bd32}, log id: 7ea76d27 >2013-12-04 05:38:14,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2271f85c >2013-12-04 05:38:15,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2271f85c >2013-12-04 05:38:15,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 262eabcf >2013-12-04 05:38:15,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e381f86, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f195eff1}, log id: 262eabcf >2013-12-04 05:38:20,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b9a1953 >2013-12-04 05:38:21,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: b9a1953 >2013-12-04 05:38:21,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d2bc364 >2013-12-04 05:38:21,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5035a4d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b7944d2}, log id: d2bc364 >2013-12-04 05:38:25,161 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-04 05:38:25,161 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:38:25,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 42484259 >2013-12-04 05:38:25,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@e34d43c0], log id: 42484259 >2013-12-04 05:38:26,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 653fa7b0 >2013-12-04 05:38:27,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 653fa7b0 >2013-12-04 05:38:27,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 708236b3 >2013-12-04 05:38:27,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@657f8ce6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e075c63a}, log id: 708236b3 >2013-12-04 05:38:32,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b5a4f9b >2013-12-04 05:38:33,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: b5a4f9b >2013-12-04 05:38:33,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e15be89 >2013-12-04 05:38:33,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae305fe9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f49d734}, log id: 1e15be89 >2013-12-04 05:38:36,739 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [3f45b52d] Attempting to update VMs/Templates Ovf. >2013-12-04 05:38:36,876 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-50) Start refreshing all users data >2013-12-04 05:38:38,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5ca341ee >2013-12-04 05:38:38,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ca341ee >2013-12-04 05:38:38,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30356563 >2013-12-04 05:38:39,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb45bbab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f397c19f}, log id: 30356563 >2013-12-04 05:38:44,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 66b74640 >2013-12-04 05:38:44,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 66b74640 >2013-12-04 05:38:44,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 352212e4 >2013-12-04 05:38:44,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9c87a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a25274e}, log id: 352212e4 >2013-12-04 05:38:47,862 INFO [org.ovirt.engine.core.bll.gluster.AddBricksToGlusterVolumeCommand] (ajp-/127.0.0.1:8702-4) [58f27a76] Running command: AddBricksToGlusterVolumeCommand internal: false. Entities affected : ID: dbfbcab7-6ec2-4bed-89de-aef7e409e97c Type: GlusterVolume >2013-12-04 05:38:47,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.AddBricksToGlusterVolumeVDSCommand] (ajp-/127.0.0.1:8702-4) [58f27a76] START, AddBricksToGlusterVolumeVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69044a70 >2013-12-04 05:38:50,007 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-85) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:38:50,427 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-85) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:38:50,471 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-85) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:38:51,731 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-85) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:38:52,264 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-85) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:38:53,453 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-85) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:38:53,493 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-85) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:38:54,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.AddBricksToGlusterVolumeVDSCommand] (ajp-/127.0.0.1:8702-4) [58f27a76] FINISH, AddBricksToGlusterVolumeVDSCommand, log id: 69044a70 >2013-12-04 05:38:54,495 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [58f27a76] No severity for GLUSTER_VOLUME_BRICK_ADDED audit log type, assuming Normal severity >2013-12-04 05:38:54,497 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [58f27a76] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Brick [/rhs/brick4/b1] on host [10.70.37.74] added to volume [dis_rep_vol] >2013-12-04 05:38:54,497 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [58f27a76] No severity for GLUSTER_VOLUME_BRICK_ADDED audit log type, assuming Normal severity >2013-12-04 05:38:54,498 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [58f27a76] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Brick [/rhs/brick4/b1] on host [10.70.37.118] added to volume [dis_rep_vol] >2013-12-04 05:38:54,502 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [58f27a76] Correlation ID: 58f27a76, Job ID: c5aa5a8b-d9bc-4ae0-9ec2-5406ac4b9c82, Call Stack: null, Custom Event ID: -1, Message: 2 brick(s) added to volume dis_rep_vol. >2013-12-04 05:38:54,506 INFO [org.ovirt.engine.core.bll.gluster.AddBricksToGlusterVolumeCommand] (ajp-/127.0.0.1:8702-4) [58f27a76] Lock freed to object EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:38:54,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 557161ac >2013-12-04 05:38:55,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 557161ac >2013-12-04 05:38:55,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1b7547ba >2013-12-04 05:38:55,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb2780c3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@366f955e}, log id: 1b7547ba >2013-12-04 05:39:00,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d36fdc6 >2013-12-04 05:39:00,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d36fdc6 >2013-12-04 05:39:00,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f6330cd >2013-12-04 05:39:01,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cd8b97a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cacc0af6}, log id: 6f6330cd >2013-12-04 05:39:01,219 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-51) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:39:01,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 48092021 >2013-12-04 05:39:01,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@50528a88, log id: 48092021 >2013-12-04 05:39:01,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5b050fea >2013-12-04 05:39:01,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6250b029, log id: 5b050fea >2013-12-04 05:39:06,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 696157ae >2013-12-04 05:39:06,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 696157ae >2013-12-04 05:39:06,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: a8697b1 >2013-12-04 05:39:07,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e7a8902, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7140d485}, log id: a8697b1 >2013-12-04 05:39:08,030 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-6) [1895f205] Lock Acquired to object EngineLock [exclusiveLocks= key: dbfbcab7-6ec2-4bed-89de-aef7e409e97c value: GLUSTER >, sharedLocks= ] >2013-12-04 05:39:08,058 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-6) [1895f205] Running command: StartRemoveGlusterVolumeBricksCommand internal: false. Entities affected : ID: dbfbcab7-6ec2-4bed-89de-aef7e409e97c Type: GlusterVolume >2013-12-04 05:39:08,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-6) [1895f205] START, StartRemoveGlusterVolumeBricksVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2bf6ea00 >2013-12-04 05:39:12,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 615bc24e >2013-12-04 05:39:17,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 615bc24e >2013-12-04 05:39:17,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5ca3832a >2013-12-04 05:39:17,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-6) [1895f205] FINISH, StartRemoveGlusterVolumeBricksVDSCommand, return: org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@e25f3dd7, log id: 2bf6ea00 >2013-12-04 05:39:17,424 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [1895f205] Correlation ID: 1895f205, Job ID: 961b20ed-6253-4c2f-8706-c669eaa89923, Call Stack: null, Custom Event ID: -1, Message: Started removing bricks from Volume dis_rep_vol >2013-12-04 05:39:17,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efc4ec6b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7365024}, log id: 5ca3832a >2013-12-04 05:39:22,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10fbcf3a >2013-12-04 05:39:23,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 10fbcf3a >2013-12-04 05:39:23,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b599957 >2013-12-04 05:39:23,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef475f64, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@648b64e}, log id: 7b599957 >2013-12-04 05:39:25,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-17) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 741c624d >2013-12-04 05:39:25,787 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) No up server in cluster >2013-12-04 05:39:25,787 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:39:25,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1043cc1b >2013-12-04 05:39:25,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-17) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@7f2a4869, log id: 741c624d >2013-12-04 05:39:26,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@9710fb3f, org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@df2fb528], log id: 1043cc1b >2013-12-04 05:39:28,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1fa2faa0 >2013-12-04 05:39:29,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fa2faa0 >2013-12-04 05:39:29,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57244133 >2013-12-04 05:39:29,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@471f79fe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cf43c45}, log id: 57244133 >2013-12-04 05:39:34,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 610b297 >2013-12-04 05:39:35,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 610b297 >2013-12-04 05:39:35,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fcef640 >2013-12-04 05:39:35,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb901937, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@874664c7}, log id: 2fcef640 >2013-12-04 05:39:35,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-16) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2c124307 >2013-12-04 05:39:36,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-16) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@3ac22441, log id: 2c124307 >2013-12-04 05:39:40,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 146180e7 >2013-12-04 05:39:40,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 146180e7 >2013-12-04 05:39:40,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c69a7c5 >2013-12-04 05:39:41,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50680dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68cd86f6}, log id: 2c69a7c5 >2013-12-04 05:39:45,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-5) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ef603cf >2013-12-04 05:39:46,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-5) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@4fe9ea56, log id: 7ef603cf >2013-12-04 05:39:46,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6b879244 >2013-12-04 05:39:46,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6b879244 >2013-12-04 05:39:46,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34928e38 >2013-12-04 05:39:47,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab3e0f6f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd87e51a}, log id: 34928e38 >2013-12-04 05:39:52,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9cc1c9e >2013-12-04 05:39:52,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 9cc1c9e >2013-12-04 05:39:52,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7312bfbb >2013-12-04 05:39:52,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@192125d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5f9635c}, log id: 7312bfbb >2013-12-04 05:39:55,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-15) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7070168d >2013-12-04 05:39:56,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-15) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@4280af69, log id: 7070168d >2013-12-04 05:39:57,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 398cc6d6 >2013-12-04 05:39:58,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 398cc6d6 >2013-12-04 05:39:58,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f987341 >2013-12-04 05:39:58,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af9266ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6df748c9}, log id: 7f987341 >2013-12-04 05:40:03,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 23f119e >2013-12-04 05:40:04,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 23f119e >2013-12-04 05:40:04,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d48b835 >2013-12-04 05:40:04,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70605ac5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5775229}, log id: 2d48b835 >2013-12-04 05:40:05,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 16b6a36c >2013-12-04 05:40:06,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@1b570a24, log id: 16b6a36c >2013-12-04 05:40:09,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 640efcc2 >2013-12-04 05:40:10,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 640efcc2 >2013-12-04 05:40:10,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 654a6b66 >2013-12-04 05:40:10,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@920fe516, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b370b9a}, log id: 654a6b66 >2013-12-04 05:40:15,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b252166 >2013-12-04 05:40:15,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2934dc84 >2013-12-04 05:40:16,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@11b26d7e, log id: 2934dc84 >2013-12-04 05:40:16,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b252166 >2013-12-04 05:40:16,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7aea6c88 >2013-12-04 05:40:16,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2811df02, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89cc1cfe}, log id: 7aea6c88 >2013-12-04 05:40:21,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a462d3 >2013-12-04 05:40:22,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6a462d3 >2013-12-04 05:40:22,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a22c341 >2013-12-04 05:40:22,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67476a3c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17782cd8}, log id: 1a22c341 >2013-12-04 05:40:25,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17631ab9 >2013-12-04 05:40:26,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@6853d2f6, log id: 17631ab9 >2013-12-04 05:40:26,645 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) No up server in cluster >2013-12-04 05:40:26,656 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:40:26,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 172ced6 >2013-12-04 05:40:27,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2173ad57 >2013-12-04 05:40:27,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@fa8e6e63, org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@2fe08906], log id: 172ced6 >2013-12-04 05:40:27,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2173ad57 >2013-12-04 05:40:27,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ee37bf9 >2013-12-04 05:40:28,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@154b49eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@627d5f9d}, log id: 6ee37bf9 >2013-12-04 05:40:33,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 64a50ce0 >2013-12-04 05:40:33,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 64a50ce0 >2013-12-04 05:40:33,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 193e3ab8 >2013-12-04 05:40:34,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31406ce7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f055028}, log id: 193e3ab8 >2013-12-04 05:40:35,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-11) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4aaab6dd >2013-12-04 05:40:36,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-11) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@4f7d88c5, log id: 4aaab6dd >2013-12-04 05:40:39,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67570b87 >2013-12-04 05:40:39,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 67570b87 >2013-12-04 05:40:39,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 351661a5 >2013-12-04 05:40:39,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@deeeb427, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cbcc5a0}, log id: 351661a5 >2013-12-04 05:40:44,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 775c6a11 >2013-12-04 05:40:45,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 775c6a11 >2013-12-04 05:40:45,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 69fa1c1b >2013-12-04 05:40:45,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d46c789e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51c6841f}, log id: 69fa1c1b >2013-12-04 05:40:45,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2a259a7f >2013-12-04 05:40:46,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@714ecfcd, log id: 2a259a7f >2013-12-04 05:40:50,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 52bfa171 >2013-12-04 05:40:51,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 52bfa171 >2013-12-04 05:40:51,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 491223d8 >2013-12-04 05:40:51,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dee40ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@354b76ae}, log id: 491223d8 >2013-12-04 05:40:55,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-6) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2a41c8f6 >2013-12-04 05:40:56,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-6) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@4213da17, log id: 2a41c8f6 >2013-12-04 05:40:56,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a7bfdb3 >2013-12-04 05:40:57,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a7bfdb3 >2013-12-04 05:40:57,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d70db6d >2013-12-04 05:40:57,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efb55a61, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62617f13}, log id: 5d70db6d >2013-12-04 05:41:02,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36833e2c >2013-12-04 05:41:03,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36833e2c >2013-12-04 05:41:03,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 35b3c893 >2013-12-04 05:41:03,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff7fbc12, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9001cf99}, log id: 35b3c893 >2013-12-04 05:41:05,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-3) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5e2d5bcc >2013-12-04 05:41:06,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-3) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@50a0962f, log id: 5e2d5bcc >2013-12-04 05:41:08,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57bddd6c >2013-12-04 05:41:08,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 57bddd6c >2013-12-04 05:41:09,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7993f65d >2013-12-04 05:41:09,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61397340, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17d22ac4}, log id: 7993f65d >2013-12-04 05:41:14,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 51bd7d77 >2013-12-04 05:41:15,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 51bd7d77 >2013-12-04 05:41:15,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f0a8f70 >2013-12-04 05:41:15,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c685a63, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@376a4001}, log id: 6f0a8f70 >2013-12-04 05:41:15,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-1) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 30bf3dcf >2013-12-04 05:41:16,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-1) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@60e3e40c, log id: 30bf3dcf >2013-12-04 05:41:20,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5fa0e90c >2013-12-04 05:41:20,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5fa0e90c >2013-12-04 05:41:20,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5a66f523 >2013-12-04 05:41:21,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2ab0651, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d34bcd30}, log id: 5a66f523 >2013-12-04 05:41:25,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-9) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70cd19ce >2013-12-04 05:41:26,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-9) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@37417d79, log id: 70cd19ce >2013-12-04 05:41:26,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 22f84ab6 >2013-12-04 05:41:26,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 22f84ab6 >2013-12-04 05:41:26,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27598f97 >2013-12-04 05:41:27,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a4f7cd2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd5b135c}, log id: 27598f97 >2013-12-04 05:41:27,672 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-04 05:41:27,679 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:41:27,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b718bc4 >2013-12-04 05:41:28,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@8e818887, org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@dd73e95c], log id: 2b718bc4 >2013-12-04 05:41:32,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e55541f >2013-12-04 05:41:32,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7e55541f >2013-12-04 05:41:32,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5a62aba4 >2013-12-04 05:41:32,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14451b8a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5914c087}, log id: 5a62aba4 >2013-12-04 05:41:35,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-7) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3eaf7fee >2013-12-04 05:41:36,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-7) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@1f85ade0, log id: 3eaf7fee >2013-12-04 05:41:38,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2370644d >2013-12-04 05:41:38,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2370644d >2013-12-04 05:41:38,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 43ff160a >2013-12-04 05:41:38,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89e7ca4c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60d1f9d0}, log id: 43ff160a >2013-12-04 05:41:43,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 727bd1fb >2013-12-04 05:41:44,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 727bd1fb >2013-12-04 05:41:44,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ef61496 >2013-12-04 05:41:44,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7722409c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a88bb903}, log id: 3ef61496 >2013-12-04 05:41:45,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-15) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 66bcee83 >2013-12-04 05:41:46,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-15) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@644009d9, log id: 66bcee83 >2013-12-04 05:41:49,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 751acf90 >2013-12-04 05:41:50,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 751acf90 >2013-12-04 05:41:50,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1fb8944f >2013-12-04 05:41:50,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a275ba44, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb0e44a6}, log id: 1fb8944f >2013-12-04 05:41:55,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 22e516ec >2013-12-04 05:41:55,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17d28e30 >2013-12-04 05:41:56,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22e516ec >2013-12-04 05:41:56,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3bd9fbde >2013-12-04 05:41:56,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@51ea5cb, log id: 17d28e30 >2013-12-04 05:41:56,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8402e703, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4c63e98}, log id: 3bd9fbde >2013-12-04 05:42:01,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 60fd259c >2013-12-04 05:42:01,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60fd259c >2013-12-04 05:42:01,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 36962e14 >2013-12-04 05:42:02,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@501f6cd3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@343dfd64}, log id: 36962e14 >2013-12-04 05:42:05,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41d76a1e >2013-12-04 05:42:06,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@57115877, log id: 41d76a1e >2013-12-04 05:42:07,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 619cd78 >2013-12-04 05:42:07,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 619cd78 >2013-12-04 05:42:07,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6bf40f54 >2013-12-04 05:42:08,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83f6a06, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c9504cb}, log id: 6bf40f54 >2013-12-04 05:42:13,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54149814 >2013-12-04 05:42:13,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 54149814 >2013-12-04 05:42:13,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5244559d >2013-12-04 05:42:14,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c10e7b67, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bd8b6d3}, log id: 5244559d >2013-12-04 05:42:19,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e4003f9 >2013-12-04 05:42:19,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7e4003f9 >2013-12-04 05:42:19,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b3cfd7f >2013-12-04 05:42:19,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efdefd94, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f0e1786}, log id: 2b3cfd7f >2013-12-04 05:42:24,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 76c07401 >2013-12-04 05:42:25,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76c07401 >2013-12-04 05:42:25,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 53b6f29f >2013-12-04 05:42:25,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dee721d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a8a19d9}, log id: 53b6f29f >2013-12-04 05:42:28,551 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) No up server in cluster >2013-12-04 05:42:28,552 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:42:28,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e805956 >2013-12-04 05:42:29,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@ea64974a, org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@dd73e95c], log id: 2e805956 >2013-12-04 05:42:30,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 21cca755 >2013-12-04 05:42:31,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 21cca755 >2013-12-04 05:42:31,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 234ae4d5 >2013-12-04 05:42:31,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75bb3a35, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@752af752}, log id: 234ae4d5 >2013-12-04 05:42:36,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 594bfc18 >2013-12-04 05:42:37,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 594bfc18 >2013-12-04 05:42:37,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: bdcbd74 >2013-12-04 05:42:37,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4749b1f3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75a50e2}, log id: bdcbd74 >2013-12-04 05:42:42,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6f8b973f >2013-12-04 05:42:43,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f8b973f >2013-12-04 05:42:43,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 77fe1b1f >2013-12-04 05:42:43,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea93eb58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d395794}, log id: 77fe1b1f >2013-12-04 05:42:48,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6d010875 >2013-12-04 05:42:48,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d010875 >2013-12-04 05:42:48,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 522a419e >2013-12-04 05:42:49,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdc8e801, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@582e7831}, log id: 522a419e >2013-12-04 05:42:54,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7664bc6b >2013-12-04 05:42:54,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7664bc6b >2013-12-04 05:42:54,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 286e7120 >2013-12-04 05:42:55,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3076e803, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a08da25}, log id: 286e7120 >2013-12-04 05:43:00,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 61375dc3 >2013-12-04 05:43:00,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61375dc3 >2013-12-04 05:43:00,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5090e5f5 >2013-12-04 05:43:00,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12bc79cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87cde29b}, log id: 5090e5f5 >2013-12-04 05:43:05,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 467c8f5e >2013-12-04 05:43:06,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 467c8f5e >2013-12-04 05:43:06,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5cc2ad64 >2013-12-04 05:43:06,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73ac2204, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdc46bf7}, log id: 5cc2ad64 >2013-12-04 05:43:11,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1c01f00e >2013-12-04 05:43:12,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1c01f00e >2013-12-04 05:43:12,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1c926014 >2013-12-04 05:43:12,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a3a62a0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a64a0e31}, log id: 1c926014 >2013-12-04 05:43:17,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53b485df >2013-12-04 05:43:18,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 53b485df >2013-12-04 05:43:18,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4e20a5e5 >2013-12-04 05:43:18,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85c87a01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e77bd2a0}, log id: 4e20a5e5 >2013-12-04 05:43:23,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 49f5ff78 >2013-12-04 05:43:24,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 49f5ff78 >2013-12-04 05:43:24,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1ea02c26 >2013-12-04 05:43:24,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68910de0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa1d8bb7}, log id: 1ea02c26 >2013-12-04 05:43:29,428 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-04 05:43:29,428 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:43:29,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 128eb368 >2013-12-04 05:43:29,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ce91247 >2013-12-04 05:43:30,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: ce91247 >2013-12-04 05:43:30,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a04a5b7 >2013-12-04 05:43:30,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@bde041a9, org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@dd73e95c], log id: 128eb368 >2013-12-04 05:43:30,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66408b85, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82989437}, log id: 3a04a5b7 >2013-12-04 05:43:35,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6889d5ee >2013-12-04 05:43:36,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6889d5ee >2013-12-04 05:43:36,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 40dd66e6 >2013-12-04 05:43:36,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bb09fac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4828962d}, log id: 40dd66e6 >2013-12-04 05:43:41,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: de03c >2013-12-04 05:43:41,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: de03c >2013-12-04 05:43:41,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 421a65fe >2013-12-04 05:43:42,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efa79d6d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3269f883}, log id: 421a65fe >2013-12-04 05:43:47,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3091dd4d >2013-12-04 05:43:47,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3091dd4d >2013-12-04 05:43:47,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1146dae8 >2013-12-04 05:43:48,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@801cc147, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25734f0e}, log id: 1146dae8 >2013-12-04 05:43:53,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41c178bd >2013-12-04 05:43:53,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 41c178bd >2013-12-04 05:43:53,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54adb427 >2013-12-04 05:43:53,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8158ed99, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fbc7379}, log id: 54adb427 >2013-12-04 05:43:59,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7287be1 >2013-12-04 05:43:59,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7287be1 >2013-12-04 05:43:59,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 404c9598 >2013-12-04 05:43:59,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce2ad6b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@811c82d9}, log id: 404c9598 >2013-12-04 05:44:01,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: fcdd35 >2013-12-04 05:44:02,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4ef818a9, log id: fcdd35 >2013-12-04 05:44:02,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 21b27c0 >2013-12-04 05:44:02,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@10fdc7f4, log id: 21b27c0 >2013-12-04 05:44:04,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 593e3305 >2013-12-04 05:44:05,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 593e3305 >2013-12-04 05:44:05,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: da3ad28 >2013-12-04 05:44:05,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7e54d58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6b5963c}, log id: da3ad28 >2013-12-04 05:44:10,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 22b136ee >2013-12-04 05:44:11,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 22b136ee >2013-12-04 05:44:11,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 781f8c88 >2013-12-04 05:44:11,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94352e6a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2801e9e}, log id: 781f8c88 >2013-12-04 05:44:16,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 53333514 >2013-12-04 05:44:17,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 53333514 >2013-12-04 05:44:17,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56622bf7 >2013-12-04 05:44:17,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f407e18c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ee79308}, log id: 56622bf7 >2013-12-04 05:44:22,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 495802c >2013-12-04 05:44:23,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 495802c >2013-12-04 05:44:23,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 17f9731a >2013-12-04 05:44:23,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b8ef3c4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11e16aa9}, log id: 17f9731a >2013-12-04 05:44:28,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1fc262 >2013-12-04 05:44:28,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fc262 >2013-12-04 05:44:28,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5ebe52a9 >2013-12-04 05:44:29,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9c60b0f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80fa6c6d}, log id: 5ebe52a9 >2013-12-04 05:44:30,355 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) No up server in cluster >2013-12-04 05:44:30,355 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:44:30,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b61863a >2013-12-04 05:44:31,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@76e12b08, org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@dd73e95c], log id: 3b61863a >2013-12-04 05:44:34,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1202200d >2013-12-04 05:44:34,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1202200d >2013-12-04 05:44:34,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 47caeabe >2013-12-04 05:44:35,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af456b9c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc54372}, log id: 47caeabe >2013-12-04 05:44:40,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1bf2e703 >2013-12-04 05:44:40,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bf2e703 >2013-12-04 05:44:40,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 48ae3eee >2013-12-04 05:44:40,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61054052, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5807585}, log id: 48ae3eee >2013-12-04 05:44:45,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 11ca838e >2013-12-04 05:44:46,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11ca838e >2013-12-04 05:44:46,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1b1d321c >2013-12-04 05:44:46,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab97c9ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@304545b1}, log id: 1b1d321c >2013-12-04 05:44:51,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41a0beba >2013-12-04 05:44:52,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 41a0beba >2013-12-04 05:44:52,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 76845bfc >2013-12-04 05:44:52,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27e5fb68, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1bf14f9}, log id: 76845bfc >2013-12-04 05:44:57,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76a5c69 >2013-12-04 05:44:58,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 76a5c69 >2013-12-04 05:44:58,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7485b2ff >2013-12-04 05:44:58,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94313db4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90b44dbd}, log id: 7485b2ff >2013-12-04 05:45:03,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 303c455 >2013-12-04 05:45:04,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 303c455 >2013-12-04 05:45:04,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4fb3b919 >2013-12-04 05:45:04,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d54128de, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@343fbc98}, log id: 4fb3b919 >2013-12-04 05:45:09,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: abdeb39 >2013-12-04 05:45:10,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: abdeb39 >2013-12-04 05:45:10,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6a97efa6 >2013-12-04 05:45:10,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dc9c820, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfce5020}, log id: 6a97efa6 >2013-12-04 05:45:15,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: f806da6 >2013-12-04 05:45:15,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: f806da6 >2013-12-04 05:45:15,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 388592ad >2013-12-04 05:45:16,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5bb0b75, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4b4913c}, log id: 388592ad >2013-12-04 05:45:21,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 279763d8 >2013-12-04 05:45:21,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 279763d8 >2013-12-04 05:45:21,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66ac3de1 >2013-12-04 05:45:22,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f772b11f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7c98025}, log id: 66ac3de1 >2013-12-04 05:45:27,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 530c3634 >2013-12-04 05:45:27,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 530c3634 >2013-12-04 05:45:27,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24453f18 >2013-12-04 05:45:27,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45c1a32f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f91b8a}, log id: 24453f18 >2013-12-04 05:45:31,345 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) No up server in cluster >2013-12-04 05:45:31,346 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:45:31,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 753a34d7 >2013-12-04 05:45:32,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@daa22d58, org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@dd73e95c], log id: 753a34d7 >2013-12-04 05:45:33,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1664e1ca >2013-12-04 05:45:33,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1664e1ca >2013-12-04 05:45:33,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b6a1a32 >2013-12-04 05:45:33,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ecd7240d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86e3ca4a}, log id: 1b6a1a32 >2013-12-04 05:45:38,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d742015 >2013-12-04 05:45:39,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7d742015 >2013-12-04 05:45:39,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: ce46a0 >2013-12-04 05:45:39,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9795e8a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ee5c447}, log id: ce46a0 >2013-12-04 05:45:44,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 74423550 >2013-12-04 05:45:45,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 74423550 >2013-12-04 05:45:45,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2112ada2 >2013-12-04 05:45:45,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e1c68f6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ece4f8b}, log id: 2112ada2 >2013-12-04 05:45:50,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c4be948 >2013-12-04 05:45:51,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c4be948 >2013-12-04 05:45:51,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54fd6f7c >2013-12-04 05:45:51,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b35309e8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b79342ea}, log id: 54fd6f7c >2013-12-04 05:45:56,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5f821168 >2013-12-04 05:45:57,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f821168 >2013-12-04 05:45:57,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 82e43f6 >2013-12-04 05:45:57,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f675da9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49a1c3df}, log id: 82e43f6 >2013-12-04 05:46:02,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7d27a6f1 >2013-12-04 05:46:03,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d27a6f1 >2013-12-04 05:46:03,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76deaf71 >2013-12-04 05:46:03,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95bb6629, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70cea26a}, log id: 76deaf71 >2013-12-04 05:46:08,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5a160d3d >2013-12-04 05:46:08,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a160d3d >2013-12-04 05:46:08,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1b521d3b >2013-12-04 05:46:09,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a339d044, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea1193ec}, log id: 1b521d3b >2013-12-04 05:46:14,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7e49b03f >2013-12-04 05:46:14,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e49b03f >2013-12-04 05:46:14,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 39b6e996 >2013-12-04 05:46:15,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81091120, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@900b4162}, log id: 39b6e996 >2013-12-04 05:46:20,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7064be83 >2013-12-04 05:46:20,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7064be83 >2013-12-04 05:46:20,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5b8f9732 >2013-12-04 05:46:20,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@728e5f51, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc52066b}, log id: 5b8f9732 >2013-12-04 05:46:25,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 623e4319 >2013-12-04 05:46:26,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 623e4319 >2013-12-04 05:46:26,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 66c6e7c8 >2013-12-04 05:46:26,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2c822e3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b38b290}, log id: 66c6e7c8 >2013-12-04 05:46:31,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 22745aa3 >2013-12-04 05:46:32,268 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) No up server in cluster >2013-12-04 05:46:32,268 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:46:32,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 492fbd1f >2013-12-04 05:46:32,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 22745aa3 >2013-12-04 05:46:32,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 149c5f8b >2013-12-04 05:46:32,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6933fb96, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d064a89c}, log id: 149c5f8b >2013-12-04 05:46:33,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@516c01ed, org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@dd73e95c], log id: 492fbd1f >2013-12-04 05:46:37,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 451bee60 >2013-12-04 05:46:38,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 451bee60 >2013-12-04 05:46:38,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: f643c0d >2013-12-04 05:46:38,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb18be13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bf6ec33}, log id: f643c0d >2013-12-04 05:46:43,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45317dc6 >2013-12-04 05:46:44,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 45317dc6 >2013-12-04 05:46:44,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: aa4a8b8 >2013-12-04 05:46:44,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@963fa291, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b64dfe6}, log id: aa4a8b8 >2013-12-04 05:46:49,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9f26b4f >2013-12-04 05:46:49,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 9f26b4f >2013-12-04 05:46:49,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 71a8655b >2013-12-04 05:46:50,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b53ba60, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9220bb5}, log id: 71a8655b >2013-12-04 05:46:55,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 29a5363f >2013-12-04 05:46:55,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 29a5363f >2013-12-04 05:46:55,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 58686233 >2013-12-04 05:46:56,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75437e51, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad201b2b}, log id: 58686233 >2013-12-04 05:47:01,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 641570ae >2013-12-04 05:47:01,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 641570ae >2013-12-04 05:47:01,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6adfadf5 >2013-12-04 05:47:02,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a9d15bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79606c31}, log id: 6adfadf5 >2013-12-04 05:47:07,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f2c6454 >2013-12-04 05:47:07,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7f2c6454 >2013-12-04 05:47:07,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74cdeb5a >2013-12-04 05:47:08,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf941340, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9b732cd}, log id: 74cdeb5a >2013-12-04 05:47:13,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4c20b8aa >2013-12-04 05:47:13,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c20b8aa >2013-12-04 05:47:13,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 201b1cbd >2013-12-04 05:47:14,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2a00e47, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9071c1cb}, log id: 201b1cbd >2013-12-04 05:47:19,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4133f442 >2013-12-04 05:47:19,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4133f442 >2013-12-04 05:47:19,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7561b0f1 >2013-12-04 05:47:19,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ee98de5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fbaa66c}, log id: 7561b0f1 >2013-12-04 05:47:25,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b613298 >2013-12-04 05:47:25,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b613298 >2013-12-04 05:47:25,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7eda557d >2013-12-04 05:47:25,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37d7ef24, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d36b5c9a}, log id: 7eda557d >2013-12-04 05:47:30,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5b165cf7 >2013-12-04 05:47:31,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5b165cf7 >2013-12-04 05:47:31,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29af7416 >2013-12-04 05:47:31,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27a4e4fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77200bbb}, log id: 29af7416 >2013-12-04 05:47:33,197 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-04 05:47:33,197 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:47:33,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 124722f8 >2013-12-04 05:47:34,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@6095142a, org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@dd73e95c], log id: 124722f8 >2013-12-04 05:47:36,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 66568c58 >2013-12-04 05:47:37,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 66568c58 >2013-12-04 05:47:37,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2375579e >2013-12-04 05:47:37,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@320cff53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f029a510}, log id: 2375579e >2013-12-04 05:47:42,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6eb40a9 >2013-12-04 05:47:43,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6eb40a9 >2013-12-04 05:47:43,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 415d81a7 >2013-12-04 05:47:43,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@480660cb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bdfd95f}, log id: 415d81a7 >2013-12-04 05:47:48,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57e80df6 >2013-12-04 05:47:49,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 57e80df6 >2013-12-04 05:47:49,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20e49c2e >2013-12-04 05:47:49,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdb23c0b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c48ef221}, log id: 20e49c2e >2013-12-04 05:47:54,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 104e63cc >2013-12-04 05:47:54,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 104e63cc >2013-12-04 05:47:54,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 231506f4 >2013-12-04 05:47:55,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f19191bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82970d30}, log id: 231506f4 >2013-12-04 05:48:00,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2b4326b5 >2013-12-04 05:48:00,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b4326b5 >2013-12-04 05:48:00,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 74d0b360 >2013-12-04 05:48:01,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4b37899, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d47a1793}, log id: 74d0b360 >2013-12-04 05:48:06,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79572206 >2013-12-04 05:48:06,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 79572206 >2013-12-04 05:48:06,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 491f8f0b >2013-12-04 05:48:06,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7523f2e5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d112d839}, log id: 491f8f0b >2013-12-04 05:48:12,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 375268a2 >2013-12-04 05:48:12,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 375268a2 >2013-12-04 05:48:12,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: f7db79f >2013-12-04 05:48:12,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@329399c7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7696087}, log id: f7db79f >2013-12-04 05:48:17,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 40dab287 >2013-12-04 05:48:18,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40dab287 >2013-12-04 05:48:18,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 60e1d001 >2013-12-04 05:48:18,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@468d7582, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcc26d45}, log id: 60e1d001 >2013-12-04 05:48:23,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 28dc52ce >2013-12-04 05:48:24,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28dc52ce >2013-12-04 05:48:24,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 47ee92d6 >2013-12-04 05:48:24,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fab6865a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82e13a60}, log id: 47ee92d6 >2013-12-04 05:48:28,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53e92239 >2013-12-04 05:48:29,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@217791ac, log id: 53e92239 >2013-12-04 05:48:29,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b361d2 >2013-12-04 05:48:30,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b361d2 >2013-12-04 05:48:30,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5d2cce1d >2013-12-04 05:48:30,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70b78cfa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e41eebb3}, log id: 5d2cce1d >2013-12-04 05:48:34,052 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-04 05:48:34,052 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:48:34,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a8ee427 >2013-12-04 05:48:34,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@41137f52, org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@dd73e95c], log id: 7a8ee427 >2013-12-04 05:48:34,998 INFO [org.ovirt.engine.core.bll.gluster.CommitRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-16) [347fbc20] Running command: CommitRemoveGlusterVolumeBricksCommand internal: false. Entities affected : ID: be2c16f2-a173-4bac-a979-47cf211a97e3 Type: GlusterVolume >2013-12-04 05:48:35,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.CommitRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-16) [347fbc20] START, CommitRemoveGlusterVolumeBricksVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f038794 >2013-12-04 05:48:35,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6341131c >2013-12-04 05:48:36,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6341131c >2013-12-04 05:48:36,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 12999f31 >2013-12-04 05:48:36,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c028ece, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61a67512}, log id: 12999f31 >2013-12-04 05:48:38,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.CommitRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-16) [347fbc20] FINISH, CommitRemoveGlusterVolumeBricksVDSCommand, log id: 1f038794 >2013-12-04 05:48:38,865 INFO [org.ovirt.engine.core.bll.gluster.CommitRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-16) [347fbc20] Lock freed to object EngineLock [exclusiveLocks= key: be2c16f2-a173-4bac-a979-47cf211a97e3 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:48:38,879 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-16) [347fbc20] Correlation ID: 347fbc20, Call Stack: null, Custom Event ID: -1, Message: Gluster volume remove bricks committed >2013-12-04 05:48:41,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5bbca3c2 >2013-12-04 05:48:41,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5bbca3c2 >2013-12-04 05:48:41,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 133f4cb6 >2013-12-04 05:48:42,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@673ab906, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71f42728}, log id: 133f4cb6 >2013-12-04 05:48:42,261 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-69) Brick order for brick 10.70.37.74:/rhs/brick1/b1 changed from 3 to 2 because of direct CLI operations. Updating engine DB accordingly. >2013-12-04 05:48:47,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2bb13571 >2013-12-04 05:48:47,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-11) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f5dfc89 >2013-12-04 05:48:47,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2bb13571 >2013-12-04 05:48:47,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 53be85e9 >2013-12-04 05:48:48,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-11) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@40314fb9, log id: 7f5dfc89 >2013-12-04 05:48:48,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a70c154, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9dbee25}, log id: 53be85e9 >2013-12-04 05:48:53,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e983d2e >2013-12-04 05:48:53,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e983d2e >2013-12-04 05:48:53,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 263b9c8 >2013-12-04 05:48:53,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cac07df, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@861a3665}, log id: 263b9c8 >2013-12-04 05:48:55,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b2fe8ea >2013-12-04 05:48:55,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@1b5cc9bf, log id: 2b2fe8ea >2013-12-04 05:48:59,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 75bc7362 >2013-12-04 05:48:59,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 75bc7362 >2013-12-04 05:48:59,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1d219599 >2013-12-04 05:48:59,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c1d7db7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c643223}, log id: 1d219599 >2013-12-04 05:49:02,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 379e0fc >2013-12-04 05:49:02,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7f5b9f4b, log id: 379e0fc >2013-12-04 05:49:02,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5837363f >2013-12-04 05:49:03,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1a7e5afd, log id: 5837363f >2013-12-04 05:49:04,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39a9d1e1 >2013-12-04 05:49:05,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 39a9d1e1 >2013-12-04 05:49:05,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f3abd5f >2013-12-04 05:49:05,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e9c264e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edc8694e}, log id: 4f3abd5f >2013-12-04 05:49:10,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 17b4b9e0 >2013-12-04 05:49:11,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17b4b9e0 >2013-12-04 05:49:11,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 418898b2 >2013-12-04 05:49:11,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2917410d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e035143}, log id: 418898b2 >2013-12-04 05:49:16,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a2062d0 >2013-12-04 05:49:17,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1a2062d0 >2013-12-04 05:49:17,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3cf218a8 >2013-12-04 05:49:17,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1d535ff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fe7e12e}, log id: 3cf218a8 >2013-12-04 05:49:22,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4d254d7 >2013-12-04 05:49:23,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d254d7 >2013-12-04 05:49:23,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1e350e14 >2013-12-04 05:49:23,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73611921, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b2b879b}, log id: 1e350e14 >2013-12-04 05:49:28,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: e8063b6 >2013-12-04 05:49:28,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: e8063b6 >2013-12-04 05:49:28,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 576f4902 >2013-12-04 05:49:29,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4820ea8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7260aaa}, log id: 576f4902 >2013-12-04 05:49:34,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 497c8fd9 >2013-12-04 05:49:34,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 497c8fd9 >2013-12-04 05:49:34,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 421708aa >2013-12-04 05:49:34,954 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-04 05:49:34,954 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:49:34,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5ec00150 >2013-12-04 05:49:35,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88ada6f1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ca7399e}, log id: 421708aa >2013-12-04 05:49:35,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@ac7aefe4], log id: 5ec00150 >2013-12-04 05:49:40,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e8976c5 >2013-12-04 05:49:40,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e8976c5 >2013-12-04 05:49:40,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4790d3b8 >2013-12-04 05:49:41,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dbf6e78, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57d0a07f}, log id: 4790d3b8 >2013-12-04 05:49:46,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4c539300 >2013-12-04 05:49:46,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c539300 >2013-12-04 05:49:46,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 15976757 >2013-12-04 05:49:46,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efe2f8ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@174952a8}, log id: 15976757 >2013-12-04 05:49:51,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70e66c2d >2013-12-04 05:49:52,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 70e66c2d >2013-12-04 05:49:52,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 451a2ee8 >2013-12-04 05:49:52,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@918032af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf5c7c0f}, log id: 451a2ee8 >2013-12-04 05:49:56,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-16) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5ddfc13f >2013-12-04 05:49:56,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-16) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@48e242fc, log id: 5ddfc13f >2013-12-04 05:49:58,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34735d88 >2013-12-04 05:49:58,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 34735d88 >2013-12-04 05:49:58,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5d54e100 >2013-12-04 05:49:58,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a706fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9f438b2}, log id: 5d54e100 >2013-12-04 05:50:03,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 208810bd >2013-12-04 05:50:04,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 208810bd >2013-12-04 05:50:04,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 44dbfea9 >2013-12-04 05:50:04,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d8dd697, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d41e8685}, log id: 44dbfea9 >2013-12-04 05:50:09,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4761b532 >2013-12-04 05:50:10,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4761b532 >2013-12-04 05:50:10,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2a57ccc0 >2013-12-04 05:50:10,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@270aad8f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@754d9186}, log id: 2a57ccc0 >2013-12-04 05:50:13,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-9) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6456b8ff >2013-12-04 05:50:13,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-9) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@4bd3e2a8, log id: 6456b8ff >2013-12-04 05:50:15,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ac23bd7 >2013-12-04 05:50:16,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1ac23bd7 >2013-12-04 05:50:16,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 75ec2d97 >2013-12-04 05:50:16,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45301d2f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a38eaa16}, log id: 75ec2d97 >2013-12-04 05:50:21,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5bd35191 >2013-12-04 05:50:22,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5bd35191 >2013-12-04 05:50:22,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5bfc8660 >2013-12-04 05:50:22,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f29bf6d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@742a3f99}, log id: 5bfc8660 >2013-12-04 05:50:27,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7af435f8 >2013-12-04 05:50:27,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7af435f8 >2013-12-04 05:50:27,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 260f1ddf >2013-12-04 05:50:28,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dce5f51d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d583155f}, log id: 260f1ddf >2013-12-04 05:50:33,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 264993e6 >2013-12-04 05:50:33,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 264993e6 >2013-12-04 05:50:33,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 74fde739 >2013-12-04 05:50:34,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cf6424, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f066cf3}, log id: 74fde739 >2013-12-04 05:50:35,555 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) No up server in cluster >2013-12-04 05:50:35,556 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:50:35,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30d7c396 >2013-12-04 05:50:36,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@5fec3118], log id: 30d7c396 >2013-12-04 05:50:39,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1b156209 >2013-12-04 05:50:39,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b156209 >2013-12-04 05:50:39,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 191525bf >2013-12-04 05:50:39,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dc4dd7a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5becd278}, log id: 191525bf >2013-12-04 05:50:44,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 494289f0 >2013-12-04 05:50:45,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 494289f0 >2013-12-04 05:50:45,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ffdfdc6 >2013-12-04 05:50:45,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67a16f85 >2013-12-04 05:50:45,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6094e91, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4438cbf}, log id: 7ffdfdc6 >2013-12-04 05:50:45,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@15e938ff, log id: 67a16f85 >2013-12-04 05:50:50,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 28bd0285 >2013-12-04 05:50:51,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 28bd0285 >2013-12-04 05:50:51,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b6a435f >2013-12-04 05:50:51,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce34df15, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25cfb91b}, log id: 4b6a435f >2013-12-04 05:50:55,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-9) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1ffeaed >2013-12-04 05:50:56,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-9) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@3b077bcd, log id: 1ffeaed >2013-12-04 05:50:56,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 15e52552 >2013-12-04 05:50:57,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 15e52552 >2013-12-04 05:50:57,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77a67dab >2013-12-04 05:50:57,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c81d9ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57e44b39}, log id: 77a67dab >2013-12-04 05:51:02,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b17e26 >2013-12-04 05:51:03,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: b17e26 >2013-12-04 05:51:03,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b19e3d2 >2013-12-04 05:51:03,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da3f623e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad5368c9}, log id: 2b19e3d2 >2013-12-04 05:51:05,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 9fe11d6 >2013-12-04 05:51:06,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@790de3bb, log id: 9fe11d6 >2013-12-04 05:51:08,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 62ca9834 >2013-12-04 05:51:08,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 62ca9834 >2013-12-04 05:51:08,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4d4757e9 >2013-12-04 05:51:09,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5b93ddb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f49736b}, log id: 4d4757e9 >2013-12-04 05:51:14,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1925690c >2013-12-04 05:51:14,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1925690c >2013-12-04 05:51:14,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 36eb5cba >2013-12-04 05:51:14,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dea909fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@506b1825}, log id: 36eb5cba >2013-12-04 05:51:15,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 64a5838d >2013-12-04 05:51:16,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@577e3273, log id: 64a5838d >2013-12-04 05:51:20,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d38cb7b >2013-12-04 05:51:20,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1d38cb7b >2013-12-04 05:51:20,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70cf1778 >2013-12-04 05:51:20,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e999b109, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dbefa18}, log id: 70cf1778 >2013-12-04 05:51:25,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 47823c31 >2013-12-04 05:51:26,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 47823c31 >2013-12-04 05:51:26,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f822974 >2013-12-04 05:51:26,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@381f2305, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8fc221}, log id: 7f822974 >2013-12-04 05:51:28,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-5) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34ee79f6 >2013-12-04 05:51:28,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-5) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@269208e4, log id: 34ee79f6 >2013-12-04 05:51:31,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2891e7ea >2013-12-04 05:51:32,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2891e7ea >2013-12-04 05:51:32,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7fb36d30 >2013-12-04 05:51:32,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19870be5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a100c65}, log id: 7fb36d30 >2013-12-04 05:51:36,395 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-04 05:51:36,395 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:51:36,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1189d875 >2013-12-04 05:51:36,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@c723dd4a], log id: 1189d875 >2013-12-04 05:51:37,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 21861b7f >2013-12-04 05:51:38,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21861b7f >2013-12-04 05:51:38,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: c629895 >2013-12-04 05:51:38,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8e6cc8c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1e4f2c1}, log id: c629895 >2013-12-04 05:51:43,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 115c6443 >2013-12-04 05:51:44,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 115c6443 >2013-12-04 05:51:44,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 36c9ea96 >2013-12-04 05:51:44,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a7a5cc7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6a3b20f}, log id: 36c9ea96 >2013-12-04 05:51:45,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-16) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55d6e61 >2013-12-04 05:51:46,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-16) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@6ac61c5a, log id: 55d6e61 >2013-12-04 05:51:49,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 67715e6e >2013-12-04 05:51:50,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 67715e6e >2013-12-04 05:51:50,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6852ee35 >2013-12-04 05:51:50,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72004b66, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f210639a}, log id: 6852ee35 >2013-12-04 05:51:55,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 65a87cf1 >2013-12-04 05:51:55,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 65a87cf1 >2013-12-04 05:51:55,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4363410a >2013-12-04 05:51:56,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5031d5ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c67c18db}, log id: 4363410a >2013-12-04 05:52:01,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2231e5fb >2013-12-04 05:52:01,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2231e5fb >2013-12-04 05:52:01,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 81bb8f7 >2013-12-04 05:52:01,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa510b61, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f561d095}, log id: 81bb8f7 >2013-12-04 05:52:07,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36c041f4 >2013-12-04 05:52:07,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36c041f4 >2013-12-04 05:52:07,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27d4419b >2013-12-04 05:52:07,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e5d57af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3f766c4}, log id: 27d4419b >2013-12-04 05:52:12,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 347c8306 >2013-12-04 05:52:13,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 347c8306 >2013-12-04 05:52:13,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 65a90f39 >2013-12-04 05:52:13,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbfded18, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a16b40c}, log id: 65a90f39 >2013-12-04 05:52:18,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30ba1821 >2013-12-04 05:52:19,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 30ba1821 >2013-12-04 05:52:19,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30cab1d0 >2013-12-04 05:52:19,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e64f64ad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29f28049}, log id: 30cab1d0 >2013-12-04 05:52:24,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59029eed >2013-12-04 05:52:25,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 59029eed >2013-12-04 05:52:25,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7131c063 >2013-12-04 05:52:25,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fb29629, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20c8b092}, log id: 7131c063 >2013-12-04 05:52:30,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 382b318 >2013-12-04 05:52:31,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 382b318 >2013-12-04 05:52:31,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d279b0d >2013-12-04 05:52:31,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cfd6d25, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32bb058c}, log id: 5d279b0d >2013-12-04 05:52:36,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: b2138df >2013-12-04 05:52:36,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b2138df >2013-12-04 05:52:36,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 525e22ca >2013-12-04 05:52:37,026 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-04 05:52:37,027 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:52:37,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16ee8256 >2013-12-04 05:52:37,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4768958a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb368635}, log id: 525e22ca >2013-12-04 05:52:37,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@bf935b12], log id: 16ee8256 >2013-12-04 05:52:40,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-11) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68c30494 >2013-12-04 05:52:41,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-11) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@3726a70, log id: 68c30494 >2013-12-04 05:52:42,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 455c344b >2013-12-04 05:52:42,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 455c344b >2013-12-04 05:52:42,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26bc0775 >2013-12-04 05:52:43,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c78fb394, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fd1228}, log id: 26bc0775 >2013-12-04 05:52:48,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26391f31 >2013-12-04 05:52:48,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 26391f31 >2013-12-04 05:52:48,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 17743de0 >2013-12-04 05:52:49,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c3343f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b2caaa2}, log id: 17743de0 >2013-12-04 05:52:51,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f5c9f05 >2013-12-04 05:52:51,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@4ed97f7f, log id: f5c9f05 >2013-12-04 05:52:54,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1efa5c2b >2013-12-04 05:52:54,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1efa5c2b >2013-12-04 05:52:54,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 69c64fa9 >2013-12-04 05:52:54,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@360040e2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65921c8a}, log id: 69c64fa9 >2013-12-04 05:52:59,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7642e33a >2013-12-04 05:53:00,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7642e33a >2013-12-04 05:53:00,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3093eb4a >2013-12-04 05:53:00,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@565a71d2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca9178dc}, log id: 3093eb4a >2013-12-04 05:53:05,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 62131ea7 >2013-12-04 05:53:06,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 62131ea7 >2013-12-04 05:53:06,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f5739a7 >2013-12-04 05:53:06,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b90f9cf4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@689d405d}, log id: 6f5739a7 >2013-12-04 05:53:11,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 55c5f436 >2013-12-04 05:53:12,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 55c5f436 >2013-12-04 05:53:12,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 35691efa >2013-12-04 05:53:12,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed669cf8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f93f6c93}, log id: 35691efa >2013-12-04 05:53:17,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 205cdb0a >2013-12-04 05:53:18,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 205cdb0a >2013-12-04 05:53:18,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25f2c512 >2013-12-04 05:53:18,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aec241af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75d4ffa8}, log id: 25f2c512 >2013-12-04 05:53:23,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ab91e6f >2013-12-04 05:53:24,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5ab91e6f >2013-12-04 05:53:24,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 478ca0e8 >2013-12-04 05:53:24,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fc7d815, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95046ca3}, log id: 478ca0e8 >2013-12-04 05:53:29,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5615c99f >2013-12-04 05:53:30,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5615c99f >2013-12-04 05:53:30,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 52b82a0f >2013-12-04 05:53:30,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff477d8e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd4f43e4}, log id: 52b82a0f >2013-12-04 05:53:35,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19d428ad >2013-12-04 05:53:35,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 19d428ad >2013-12-04 05:53:35,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 72e6a677 >2013-12-04 05:53:36,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f78e00bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@842c53c4}, log id: 72e6a677 >2013-12-04 05:53:37,679 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) No up server in cluster >2013-12-04 05:53:37,688 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:53:37,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ff65a4b >2013-12-04 05:53:38,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@f5653b2f], log id: 4ff65a4b >2013-12-04 05:53:41,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 656c4a8e >2013-12-04 05:53:41,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 656c4a8e >2013-12-04 05:53:41,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34163bc8 >2013-12-04 05:53:42,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbe62624, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41c0e01}, log id: 34163bc8 >2013-12-04 05:53:47,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 289691b5 >2013-12-04 05:53:47,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 289691b5 >2013-12-04 05:53:47,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 44afc1e8 >2013-12-04 05:53:48,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3f9d63e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9afac25}, log id: 44afc1e8 >2013-12-04 05:53:53,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 23c6ac5a >2013-12-04 05:53:53,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 23c6ac5a >2013-12-04 05:53:53,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3213bdfd >2013-12-04 05:53:53,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccb1b63e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3de1563a}, log id: 3213bdfd >2013-12-04 05:53:58,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 745d4718 >2013-12-04 05:53:59,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 745d4718 >2013-12-04 05:53:59,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 99bf042 >2013-12-04 05:53:59,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96993192, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6ec0ba9}, log id: 99bf042 >2013-12-04 05:54:03,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 9de31a2 >2013-12-04 05:54:03,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1a9983fd, log id: 9de31a2 >2013-12-04 05:54:03,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 54a864af >2013-12-04 05:54:03,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@653cf3ce, log id: 54a864af >2013-12-04 05:54:04,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b2c9d8a >2013-12-04 05:54:05,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b2c9d8a >2013-12-04 05:54:05,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15de305a >2013-12-04 05:54:05,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@846d4f3b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@caee7be0}, log id: 15de305a >2013-12-04 05:54:10,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7c1d91b4 >2013-12-04 05:54:11,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c1d91b4 >2013-12-04 05:54:11,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b9c0642 >2013-12-04 05:54:11,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@975c7e69, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6d57580}, log id: 6b9c0642 >2013-12-04 05:54:16,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 25cb90c8 >2013-12-04 05:54:17,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 25cb90c8 >2013-12-04 05:54:17,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3978c529 >2013-12-04 05:54:17,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad2864e2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30a4587f}, log id: 3978c529 >2013-12-04 05:54:22,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6bf0613d >2013-12-04 05:54:22,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6bf0613d >2013-12-04 05:54:22,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 60f8c5e2 >2013-12-04 05:54:23,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa44d7c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a557ef05}, log id: 60f8c5e2 >2013-12-04 05:54:28,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4daa5bd >2013-12-04 05:54:28,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4daa5bd >2013-12-04 05:54:28,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a3dcdab >2013-12-04 05:54:29,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65a8bd53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abe2bf}, log id: 4a3dcdab >2013-12-04 05:54:34,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 348de361 >2013-12-04 05:54:34,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 348de361 >2013-12-04 05:54:34,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a4bbfd5 >2013-12-04 05:54:34,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8385e5a7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab613be7}, log id: 6a4bbfd5 >2013-12-04 05:54:38,350 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-04 05:54:38,351 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:54:38,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3dc9037a >2013-12-04 05:54:38,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@f8cd1398], log id: 3dc9037a >2013-12-04 05:54:39,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34fe23c6 >2013-12-04 05:54:40,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 34fe23c6 >2013-12-04 05:54:40,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39091950 >2013-12-04 05:54:40,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bdb244e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3cbc1e4}, log id: 39091950 >2013-12-04 05:54:45,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7fc0a92b >2013-12-04 05:54:46,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fc0a92b >2013-12-04 05:54:46,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 11d8d29a >2013-12-04 05:54:46,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c1f47b6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bac2058e}, log id: 11d8d29a >2013-12-04 05:54:51,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d91ec37 >2013-12-04 05:54:52,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d91ec37 >2013-12-04 05:54:52,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3df12c0 >2013-12-04 05:54:52,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21738ef4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ef306a4}, log id: 3df12c0 >2013-12-04 05:54:57,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4f61d700 >2013-12-04 05:54:58,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f61d700 >2013-12-04 05:54:58,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5731e9c8 >2013-12-04 05:54:58,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee0a468e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1e8fc76}, log id: 5731e9c8 >2013-12-04 05:55:03,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 354f2941 >2013-12-04 05:55:04,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 354f2941 >2013-12-04 05:55:04,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c88119f >2013-12-04 05:55:04,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cba2307, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0b337f3}, log id: 3c88119f >2013-12-04 05:55:09,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11a5843b >2013-12-04 05:55:10,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 11a5843b >2013-12-04 05:55:10,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 689ff1fa >2013-12-04 05:55:10,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34de8dc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ed63a26}, log id: 689ff1fa >2013-12-04 05:55:15,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6a5b073c >2013-12-04 05:55:15,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a5b073c >2013-12-04 05:55:15,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4552660d >2013-12-04 05:55:16,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71586c3e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a0d4d54}, log id: 4552660d >2013-12-04 05:55:21,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4218ef3a >2013-12-04 05:55:21,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4218ef3a >2013-12-04 05:55:21,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: dbb80c >2013-12-04 05:55:22,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b733bae2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8cb9b9f}, log id: dbb80c >2013-12-04 05:55:27,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36153250 >2013-12-04 05:55:27,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 36153250 >2013-12-04 05:55:27,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6b8ee4ee >2013-12-04 05:55:27,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd044cc0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d5f8fef}, log id: 6b8ee4ee >2013-12-04 05:55:33,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39aa8534 >2013-12-04 05:55:33,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 39aa8534 >2013-12-04 05:55:33,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9bd5846 >2013-12-04 05:55:33,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ead973d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8cc9b8f}, log id: 9bd5846 >2013-12-04 05:55:38,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7a14073 >2013-12-04 05:55:39,000 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [54e92961] No up server in cluster >2013-12-04 05:55:39,000 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [54e92961] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:55:39,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b44cdb3 >2013-12-04 05:55:39,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a14073 >2013-12-04 05:55:39,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 381c8b55 >2013-12-04 05:55:39,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@96b8a54a], log id: 2b44cdb3 >2013-12-04 05:55:39,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f59aa7cb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c055b570}, log id: 381c8b55 >2013-12-04 05:55:44,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 41dc6d57 >2013-12-04 05:55:45,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41dc6d57 >2013-12-04 05:55:45,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5a2aaca5 >2013-12-04 05:55:45,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9bf7078, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1d5416f}, log id: 5a2aaca5 >2013-12-04 05:55:50,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 13d15be6 >2013-12-04 05:55:51,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 13d15be6 >2013-12-04 05:55:51,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5ecddad2 >2013-12-04 05:55:51,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e601ead, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ced4b14}, log id: 5ecddad2 >2013-12-04 05:55:56,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12305248 >2013-12-04 05:55:57,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 12305248 >2013-12-04 05:55:57,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6a1e82cd >2013-12-04 05:55:57,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d319e603, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9fc2615}, log id: 6a1e82cd >2013-12-04 05:56:02,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 39dd0465 >2013-12-04 05:56:02,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39dd0465 >2013-12-04 05:56:02,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5b567395 >2013-12-04 05:56:03,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@471c332c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@379a942a}, log id: 5b567395 >2013-12-04 05:56:08,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 743adfd6 >2013-12-04 05:56:08,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 743adfd6 >2013-12-04 05:56:08,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ab904ad >2013-12-04 05:56:09,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@955311a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfdbb1cc}, log id: 6ab904ad >2013-12-04 05:56:14,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61c9cdf1 >2013-12-04 05:56:14,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 61c9cdf1 >2013-12-04 05:56:14,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57123450 >2013-12-04 05:56:14,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0bf5566, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b6c2e0a}, log id: 57123450 >2013-12-04 05:56:20,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ece2a47 >2013-12-04 05:56:20,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7ece2a47 >2013-12-04 05:56:20,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46291b0 >2013-12-04 05:56:20,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63295a34, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e45cbc3}, log id: 46291b0 >2013-12-04 05:56:25,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 707c578a >2013-12-04 05:56:26,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 707c578a >2013-12-04 05:56:26,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2bc49eb2 >2013-12-04 05:56:26,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@830c09ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@238ccbfd}, log id: 2bc49eb2 >2013-12-04 05:56:31,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 41788daf >2013-12-04 05:56:32,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41788daf >2013-12-04 05:56:32,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 66e98783 >2013-12-04 05:56:32,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78e48bd7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63418eec}, log id: 66e98783 >2013-12-04 05:56:37,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2273a5f9 >2013-12-04 05:56:38,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2273a5f9 >2013-12-04 05:56:38,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 728b014b >2013-12-04 05:56:38,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e111e8ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@643d5660}, log id: 728b014b >2013-12-04 05:56:39,536 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-04 05:56:39,536 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:56:39,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6a4ee89 >2013-12-04 05:56:40,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@dd5a2628], log id: 6a4ee89 >2013-12-04 05:56:43,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 51252c1c >2013-12-04 05:56:44,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51252c1c >2013-12-04 05:56:44,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 73bd67a0 >2013-12-04 05:56:44,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3112db8c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8a4b9d8}, log id: 73bd67a0 >2013-12-04 05:56:49,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7bbbba44 >2013-12-04 05:56:49,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7bbbba44 >2013-12-04 05:56:49,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 212a87ea >2013-12-04 05:56:50,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@369e1b8e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8692b0ee}, log id: 212a87ea >2013-12-04 05:56:55,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b8d7dd7 >2013-12-04 05:56:55,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b8d7dd7 >2013-12-04 05:56:55,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ef554d9 >2013-12-04 05:56:56,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81a8b055, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fa49150}, log id: 1ef554d9 >2013-12-04 05:57:00,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-11) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 688686eb >2013-12-04 05:57:00,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-11) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@1c56685f, log id: 688686eb >2013-12-04 05:57:01,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ede1dad >2013-12-04 05:57:01,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7ede1dad >2013-12-04 05:57:01,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: a4112e3 >2013-12-04 05:57:01,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec83c713, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b20a4c7}, log id: a4112e3 >2013-12-04 05:57:07,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28680e4a >2013-12-04 05:57:07,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 28680e4a >2013-12-04 05:57:07,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6cb62ac2 >2013-12-04 05:57:07,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a98aa308, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8797396e}, log id: 6cb62ac2 >2013-12-04 05:57:12,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75e9a5f6 >2013-12-04 05:57:13,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 75e9a5f6 >2013-12-04 05:57:13,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 78db51f6 >2013-12-04 05:57:13,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4d0cd1a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d756042}, log id: 78db51f6 >2013-12-04 05:57:18,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 275b7a6d >2013-12-04 05:57:19,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 275b7a6d >2013-12-04 05:57:19,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 31fe2a96 >2013-12-04 05:57:19,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b6c8d1d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86aff621}, log id: 31fe2a96 >2013-12-04 05:57:24,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5e135945 >2013-12-04 05:57:25,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5e135945 >2013-12-04 05:57:25,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34c10e40 >2013-12-04 05:57:25,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cee5e0ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af5197a2}, log id: 34c10e40 >2013-12-04 05:57:30,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21878933 >2013-12-04 05:57:31,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 21878933 >2013-12-04 05:57:31,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1f373562 >2013-12-04 05:57:31,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7607c5de, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ac579c8}, log id: 1f373562 >2013-12-04 05:57:36,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b7f140c >2013-12-04 05:57:36,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b7f140c >2013-12-04 05:57:36,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66f1abf1 >2013-12-04 05:57:37,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f0ffb78, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6db3d5d5}, log id: 66f1abf1 >2013-12-04 05:57:40,154 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [6e7f0088] No up server in cluster >2013-12-04 05:57:40,161 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [6e7f0088] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:57:40,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 57c23553 >2013-12-04 05:57:40,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@cf8f4d30], log id: 57c23553 >2013-12-04 05:57:42,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 315ad7b4 >2013-12-04 05:57:42,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 315ad7b4 >2013-12-04 05:57:42,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9705314 >2013-12-04 05:57:43,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41f5fdac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae789d50}, log id: 9705314 >2013-12-04 05:57:48,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 447dbfb9 >2013-12-04 05:57:48,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 447dbfb9 >2013-12-04 05:57:48,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19c2e68 >2013-12-04 05:57:48,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f137091, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36c1af52}, log id: 19c2e68 >2013-12-04 05:57:54,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18dc6e1d >2013-12-04 05:57:54,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 18dc6e1d >2013-12-04 05:57:54,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c49d558 >2013-12-04 05:57:54,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51c77aa6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48b59f97}, log id: 4c49d558 >2013-12-04 05:57:59,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: fbca6f2 >2013-12-04 05:58:00,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: fbca6f2 >2013-12-04 05:58:00,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1afeb58e >2013-12-04 05:58:00,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33a92cd5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1863f914}, log id: 1afeb58e >2013-12-04 05:58:05,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f3da90b >2013-12-04 05:58:06,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6f3da90b >2013-12-04 05:58:06,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d6790e9 >2013-12-04 05:58:06,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@500c2436, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6515783d}, log id: 3d6790e9 >2013-12-04 05:58:11,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5175713f >2013-12-04 05:58:12,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5175713f >2013-12-04 05:58:12,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47e53464 >2013-12-04 05:58:12,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af0a97c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53b15232}, log id: 47e53464 >2013-12-04 05:58:17,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41aef8d8 >2013-12-04 05:58:17,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 41aef8d8 >2013-12-04 05:58:17,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2f949afe >2013-12-04 05:58:18,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3fc4487, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39d9d83f}, log id: 2f949afe >2013-12-04 05:58:23,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4558d5c8 >2013-12-04 05:58:23,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4558d5c8 >2013-12-04 05:58:23,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c8e0164 >2013-12-04 05:58:24,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53bfc627, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5a44d9b}, log id: 4c8e0164 >2013-12-04 05:58:29,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2150e1b >2013-12-04 05:58:29,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2150e1b >2013-12-04 05:58:29,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20e609e2 >2013-12-04 05:58:29,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f7a714d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@976cc25b}, log id: 20e609e2 >2013-12-04 05:58:34,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 565c0c0d >2013-12-04 05:58:35,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 565c0c0d >2013-12-04 05:58:35,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 329f699b >2013-12-04 05:58:35,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c3032a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51564d4a}, log id: 329f699b >2013-12-04 05:58:40,743 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-61) No up server in cluster >2013-12-04 05:58:40,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 238307b6 >2013-12-04 05:58:40,743 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-61) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:58:40,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7930a0f3 >2013-12-04 05:58:41,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 238307b6 >2013-12-04 05:58:41,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8bddc2b >2013-12-04 05:58:41,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@f33c8bf2], log id: 7930a0f3 >2013-12-04 05:58:41,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc8c220, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8dd0fdd}, log id: 8bddc2b >2013-12-04 05:58:46,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6d930887 >2013-12-04 05:58:47,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d930887 >2013-12-04 05:58:47,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 79debb81 >2013-12-04 05:58:47,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b896637, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@436880f5}, log id: 79debb81 >2013-12-04 05:58:52,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68021ef2 >2013-12-04 05:58:53,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 68021ef2 >2013-12-04 05:58:53,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3fe149ec >2013-12-04 05:58:53,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a26ac7ac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b47e10b5}, log id: 3fe149ec >2013-12-04 05:58:58,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 18564179 >2013-12-04 05:58:58,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18564179 >2013-12-04 05:58:58,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: c695f35 >2013-12-04 05:58:59,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86515f90, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d5271e1}, log id: c695f35 >2013-12-04 05:59:03,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59ddee2a >2013-12-04 05:59:04,194 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-16) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:59:04,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@35119cef, log id: 59ddee2a >2013-12-04 05:59:04,225 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-92) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:59:04,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17562a21 >2013-12-04 05:59:04,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 17562a21 >2013-12-04 05:59:04,750 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-92) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:59:04,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ab0b085 >2013-12-04 05:59:04,926 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-92) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:59:04,967 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-92) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 05:59:05,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75edeca7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fe35c4f}, log id: 7ab0b085 >2013-12-04 05:59:05,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 74d7d01b >2013-12-04 05:59:05,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4a0c50f6, log id: 74d7d01b >2013-12-04 05:59:10,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 230b1301 >2013-12-04 05:59:10,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 230b1301 >2013-12-04 05:59:10,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42a6dc69 >2013-12-04 05:59:10,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@734bdf6f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ea7d045}, log id: 42a6dc69 >2013-12-04 05:59:15,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3504672a >2013-12-04 05:59:16,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3504672a >2013-12-04 05:59:16,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 33b4097c >2013-12-04 05:59:16,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fa49226, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a166e02}, log id: 33b4097c >2013-12-04 05:59:21,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 408440e2 >2013-12-04 05:59:22,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 408440e2 >2013-12-04 05:59:22,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 407105e0 >2013-12-04 05:59:22,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df37d0c4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78f1d700}, log id: 407105e0 >2013-12-04 05:59:27,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36528144 >2013-12-04 05:59:28,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36528144 >2013-12-04 05:59:28,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b4eb988 >2013-12-04 05:59:28,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18de2e2d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f655ee12}, log id: 3b4eb988 >2013-12-04 05:59:33,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47f9e16 >2013-12-04 05:59:33,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 47f9e16 >2013-12-04 05:59:33,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e2d1716 >2013-12-04 05:59:34,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92f8b3d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2765c19}, log id: 7e2d1716 >2013-12-04 05:59:37,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 63c51222 >2013-12-04 05:59:38,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@51b628d5, log id: 63c51222 >2013-12-04 05:59:39,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24d47687 >2013-12-04 05:59:39,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 24d47687 >2013-12-04 05:59:39,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38ff9cce >2013-12-04 05:59:40,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d71d122, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b18063fd}, log id: 38ff9cce >2013-12-04 05:59:41,382 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) No up server in cluster >2013-12-04 05:59:41,437 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 05:59:41,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9d0cb6 >2013-12-04 05:59:42,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@a799a68], log id: 9d0cb6 >2013-12-04 05:59:45,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 73d42187 >2013-12-04 05:59:45,363 INFO [org.ovirt.engine.core.bll.gluster.CommitRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-4) [7211592b] Running command: CommitRemoveGlusterVolumeBricksCommand internal: false. Entities affected : ID: dbfbcab7-6ec2-4bed-89de-aef7e409e97c Type: GlusterVolume >2013-12-04 05:59:45,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.CommitRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-4) [7211592b] START, CommitRemoveGlusterVolumeBricksVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5c4665ae >2013-12-04 05:59:45,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 73d42187 >2013-12-04 05:59:45,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 209508e8 >2013-12-04 05:59:45,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9734769b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54b9d81f}, log id: 209508e8 >2013-12-04 05:59:50,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e392ad5 >2013-12-04 05:59:52,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.CommitRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-4) [7211592b] FINISH, CommitRemoveGlusterVolumeBricksVDSCommand, log id: 5c4665ae >2013-12-04 05:59:52,739 INFO [org.ovirt.engine.core.bll.gluster.CommitRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-4) [7211592b] Lock freed to object EngineLock [exclusiveLocks= key: dbfbcab7-6ec2-4bed-89de-aef7e409e97c value: GLUSTER >, sharedLocks= ] >2013-12-04 05:59:52,745 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [7211592b] Correlation ID: 7211592b, Call Stack: null, Custom Event ID: -1, Message: Gluster volume remove bricks committed >2013-12-04 05:59:52,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e392ad5 >2013-12-04 05:59:52,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1cb8730b >2013-12-04 05:59:53,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6e59c7a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93aa16c}, log id: 1cb8730b >2013-12-04 05:59:53,295 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-45) Brick order for brick 10.70.37.74:/rhs/brick4/b1 changed from 6 to 4 because of direct CLI operations. Updating engine DB accordingly. >2013-12-04 05:59:53,299 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-45) Brick order for brick 10.70.37.118:/rhs/brick4/b1 changed from 7 to 5 because of direct CLI operations. Updating engine DB accordingly. >2013-12-04 05:59:58,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: af45a2c >2013-12-04 05:59:58,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: af45a2c >2013-12-04 05:59:58,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 92585bf >2013-12-04 05:59:59,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5329888, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9369b6a5}, log id: 92585bf >2013-12-04 06:00:04,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 55cb6796 >2013-12-04 06:00:04,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 55cb6796 >2013-12-04 06:00:04,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 66db6e33 >2013-12-04 06:00:04,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4768e06b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64a30154}, log id: 66db6e33 >2013-12-04 06:00:09,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 8787ddd >2013-12-04 06:00:10,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 8787ddd >2013-12-04 06:00:10,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5df351e6 >2013-12-04 06:00:10,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f908641, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4925884b}, log id: 5df351e6 >2013-12-04 06:00:15,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a216d3a >2013-12-04 06:00:16,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a216d3a >2013-12-04 06:00:16,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4d634d7f >2013-12-04 06:00:16,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e90f97ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbc1c390}, log id: 4d634d7f >2013-12-04 06:00:21,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1d11932c >2013-12-04 06:00:22,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d11932c >2013-12-04 06:00:22,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 15bb6d81 >2013-12-04 06:00:22,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21a04d3a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50a191ec}, log id: 15bb6d81 >2013-12-04 06:00:27,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e62f19f >2013-12-04 06:00:27,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3e62f19f >2013-12-04 06:00:27,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: fa6ffe6 >2013-12-04 06:00:28,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f6d4fa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7e29d5}, log id: fa6ffe6 >2013-12-04 06:00:33,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4ce652a4 >2013-12-04 06:00:33,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ce652a4 >2013-12-04 06:00:33,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d54675f >2013-12-04 06:00:34,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80c0dee6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ed7edf4}, log id: 3d54675f >2013-12-04 06:00:39,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 430b9ba >2013-12-04 06:00:39,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 430b9ba >2013-12-04 06:00:39,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ac57874 >2013-12-04 06:00:39,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3f7bbcb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8527d123}, log id: 2ac57874 >2013-12-04 06:00:42,040 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-04 06:00:42,040 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:00:42,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4f01c801 >2013-12-04 06:00:42,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4f01c801 >2013-12-04 06:00:44,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 61327269 >2013-12-04 06:00:45,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 61327269 >2013-12-04 06:00:45,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c95e79 >2013-12-04 06:00:45,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c9c329e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@932448e3}, log id: 6c95e79 >2013-12-04 06:00:50,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1fe88951 >2013-12-04 06:00:51,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1fe88951 >2013-12-04 06:00:51,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3bd3a6eb >2013-12-04 06:00:51,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7663ac58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6686abd5}, log id: 3bd3a6eb >2013-12-04 06:00:56,335 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-9) [703c9568] Lock Acquired to object EngineLock [exclusiveLocks= key: dbfbcab7-6ec2-4bed-89de-aef7e409e97c value: GLUSTER >, sharedLocks= ] >2013-12-04 06:00:56,344 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-9) [703c9568] Running command: StartRemoveGlusterVolumeBricksCommand internal: false. Entities affected : ID: dbfbcab7-6ec2-4bed-89de-aef7e409e97c Type: GlusterVolume >2013-12-04 06:00:56,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-9) [703c9568] START, StartRemoveGlusterVolumeBricksVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 58758510 >2013-12-04 06:00:56,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 41e97275 >2013-12-04 06:01:02,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41e97275 >2013-12-04 06:01:02,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 795c92c7 >2013-12-04 06:01:02,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8a4da4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dadadc3}, log id: 795c92c7 >2013-12-04 06:01:07,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 382d4df8 >2013-12-04 06:01:07,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 382d4df8 >2013-12-04 06:01:07,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 21cca901 >2013-12-04 06:01:08,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@beb9d0fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10c8dbfe}, log id: 21cca901 >2013-12-04 06:01:09,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-9) [703c9568] FINISH, StartRemoveGlusterVolumeBricksVDSCommand, return: org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@20babbe0, log id: 58758510 >2013-12-04 06:01:09,446 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [703c9568] Correlation ID: 703c9568, Job ID: c962246c-b52b-4f6c-b297-6decc47ccfe0, Call Stack: null, Custom Event ID: -1, Message: Started removing bricks from Volume dis_rep_vol >2013-12-04 06:01:12,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 231cc815 >2013-12-04 06:01:12,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@169c895f, log id: 231cc815 >2013-12-04 06:01:13,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 426bdd4 >2013-12-04 06:01:13,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 426bdd4 >2013-12-04 06:01:13,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ea8842c >2013-12-04 06:01:14,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0252a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29ceb81d}, log id: 6ea8842c >2013-12-04 06:01:19,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6be614e9 >2013-12-04 06:01:19,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6be614e9 >2013-12-04 06:01:19,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4e64cf8 >2013-12-04 06:01:19,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b63fbf7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af70ef46}, log id: 4e64cf8 >2013-12-04 06:01:22,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ce5105f >2013-12-04 06:01:23,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@181704c7, log id: 2ce5105f >2013-12-04 06:01:24,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 17fc9d38 >2013-12-04 06:01:25,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 17fc9d38 >2013-12-04 06:01:25,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43270189 >2013-12-04 06:01:25,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bc55ae2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@780f92d9}, log id: 43270189 >2013-12-04 06:01:30,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2b8c4cbe >2013-12-04 06:01:31,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b8c4cbe >2013-12-04 06:01:31,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 501bb879 >2013-12-04 06:01:31,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3ac01f0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@488fdde1}, log id: 501bb879 >2013-12-04 06:01:32,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6fb02eb2 >2013-12-04 06:01:33,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@5e66c53a, log id: 6fb02eb2 >2013-12-04 06:01:36,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5085f643 >2013-12-04 06:01:37,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5085f643 >2013-12-04 06:01:37,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2148f6eb >2013-12-04 06:01:37,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3240da48, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bf6c814}, log id: 2148f6eb >2013-12-04 06:01:42,356 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-04 06:01:42,357 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:01:42,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 65957896 >2013-12-04 06:01:42,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: e6c9ac5 >2013-12-04 06:01:42,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 668daa82 >2013-12-04 06:01:42,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@7e81179a], log id: 65957896 >2013-12-04 06:01:42,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: e6c9ac5 >2013-12-04 06:01:42,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: ada366c >2013-12-04 06:01:43,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@29c3c067, log id: 668daa82 >2013-12-04 06:01:43,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@683cf959, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82df707c}, log id: ada366c >2013-12-04 06:01:48,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 447ebb0b >2013-12-04 06:01:48,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 447ebb0b >2013-12-04 06:01:48,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 35f8ad72 >2013-12-04 06:01:49,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a24a9f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1fa87b0}, log id: 35f8ad72 >2013-12-04 06:01:52,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39500e2e >2013-12-04 06:01:53,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@1e6ab57, log id: 39500e2e >2013-12-04 06:01:54,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14c4f83f >2013-12-04 06:01:54,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 14c4f83f >2013-12-04 06:01:54,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b00cfc8 >2013-12-04 06:01:54,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e55a1bec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@997f61d}, log id: 2b00cfc8 >2013-12-04 06:01:59,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48c8fd00 >2013-12-04 06:02:00,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 48c8fd00 >2013-12-04 06:02:00,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1fd23c59 >2013-12-04 06:02:00,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a4c008c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b148c651}, log id: 1fd23c59 >2013-12-04 06:02:02,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3527d940 >2013-12-04 06:02:03,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@18702462, log id: 3527d940 >2013-12-04 06:02:05,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 304db118 >2013-12-04 06:02:06,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 304db118 >2013-12-04 06:02:06,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7122c66c >2013-12-04 06:02:06,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f333750, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39ff2697}, log id: 7122c66c >2013-12-04 06:02:11,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: defc713 >2013-12-04 06:02:12,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: defc713 >2013-12-04 06:02:12,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 212b80e0 >2013-12-04 06:02:12,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8e8761f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9decfab3}, log id: 212b80e0 >2013-12-04 06:02:12,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-7) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1a13bf62 >2013-12-04 06:02:13,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-7) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@52c04edd, log id: 1a13bf62 >2013-12-04 06:02:17,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20a17d2a >2013-12-04 06:02:18,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 20a17d2a >2013-12-04 06:02:18,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5eca0a51 >2013-12-04 06:02:18,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7aa52377, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8e10846}, log id: 5eca0a51 >2013-12-04 06:02:22,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 407b7b51 >2013-12-04 06:02:23,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@40f58d6a, log id: 407b7b51 >2013-12-04 06:02:23,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ac61872 >2013-12-04 06:02:24,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ac61872 >2013-12-04 06:02:24,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1176f209 >2013-12-04 06:02:24,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45ad85c8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f483e67c}, log id: 1176f209 >2013-12-04 06:02:29,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 669b59eb >2013-12-04 06:02:29,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 669b59eb >2013-12-04 06:02:29,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 8b3c50 >2013-12-04 06:02:30,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a62a1e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec282396}, log id: 8b3c50 >2013-12-04 06:02:32,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5cb52822 >2013-12-04 06:02:33,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@33fcc272, log id: 5cb52822 >2013-12-04 06:02:35,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 35064562 >2013-12-04 06:02:35,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 35064562 >2013-12-04 06:02:35,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 37696ae5 >2013-12-04 06:02:36,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [1125b869] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c81bcfc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70f4a297}, log id: 37696ae5 >2013-12-04 06:02:41,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 50a4d1b2 >2013-12-04 06:02:41,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 50a4d1b2 >2013-12-04 06:02:41,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c00828e >2013-12-04 06:02:42,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88ef06b1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6664694}, log id: 5c00828e >2013-12-04 06:02:42,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-5) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 10d1a90f >2013-12-04 06:02:42,924 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-04 06:02:42,935 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:02:42,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 439fef51 >2013-12-04 06:02:43,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-5) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@7e944f81, log id: 10d1a90f >2013-12-04 06:02:43,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@1c1f6bbd], log id: 439fef51 >2013-12-04 06:02:47,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14b549cf >2013-12-04 06:02:47,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 14b549cf >2013-12-04 06:02:47,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6636ad6e >2013-12-04 06:02:47,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79eaa55e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65e6bcd1}, log id: 6636ad6e >2013-12-04 06:02:52,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5342b220 >2013-12-04 06:02:52,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 315b43cb >2013-12-04 06:02:53,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@73ffcdd2, log id: 5342b220 >2013-12-04 06:02:53,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 315b43cb >2013-12-04 06:02:53,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b571632 >2013-12-04 06:02:53,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@135db5fe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a1898f}, log id: 2b571632 >2013-12-04 06:02:58,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1c3bc6b6 >2013-12-04 06:02:59,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1c3bc6b6 >2013-12-04 06:02:59,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 794ac45b >2013-12-04 06:02:59,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c22fdbb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e926c563}, log id: 794ac45b >2013-12-04 06:03:02,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d86a295 >2013-12-04 06:03:03,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@24c83f43, log id: 6d86a295 >2013-12-04 06:03:04,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b85b8aa >2013-12-04 06:03:05,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b85b8aa >2013-12-04 06:03:05,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76bfb16c >2013-12-04 06:03:05,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d32b2a0c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe4621dd}, log id: 76bfb16c >2013-12-04 06:03:10,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f33ee7b >2013-12-04 06:03:11,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5f33ee7b >2013-12-04 06:03:11,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 781ede82 >2013-12-04 06:03:11,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36eef5b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b113d1be}, log id: 781ede82 >2013-12-04 06:03:12,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2580a086 >2013-12-04 06:03:13,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@2b31c383, log id: 2580a086 >2013-12-04 06:03:16,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2155412c >2013-12-04 06:03:17,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2155412c >2013-12-04 06:03:17,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c6abd9f >2013-12-04 06:03:17,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2d0044f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ad3e5dc}, log id: 3c6abd9f >2013-12-04 06:03:22,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f3c435d >2013-12-04 06:03:22,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7ac420dd >2013-12-04 06:03:22,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: f3c435d >2013-12-04 06:03:22,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e9d20eb >2013-12-04 06:03:23,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@38584248, log id: 7ac420dd >2013-12-04 06:03:23,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1940063a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b44c6fb6}, log id: 2e9d20eb >2013-12-04 06:03:28,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 678c5c78 >2013-12-04 06:03:28,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 678c5c78 >2013-12-04 06:03:28,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3c0a98c3 >2013-12-04 06:03:28,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15a57561, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e3a6e48}, log id: 3c0a98c3 >2013-12-04 06:03:32,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-5) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4eda76d8 >2013-12-04 06:03:33,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-5) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@7e69d34f, log id: 4eda76d8 >2013-12-04 06:03:34,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7d801ce6 >2013-12-04 06:03:34,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d801ce6 >2013-12-04 06:03:34,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6bf61fe5 >2013-12-04 06:03:34,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a75434e4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51669c8}, log id: 6bf61fe5 >2013-12-04 06:03:39,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 291e2378 >2013-12-04 06:03:40,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 291e2378 >2013-12-04 06:03:40,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 12ba0b2e >2013-12-04 06:03:40,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@415797ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c68a4869}, log id: 12ba0b2e >2013-12-04 06:03:42,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5dc9a2f3 >2013-12-04 06:03:43,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@79a52359, log id: 5dc9a2f3 >2013-12-04 06:03:43,602 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) No up server in cluster >2013-12-04 06:03:43,602 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:03:43,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 44e0c954 >2013-12-04 06:03:44,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@40ef49eb], log id: 44e0c954 >2013-12-04 06:03:45,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4505e526 >2013-12-04 06:03:46,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4505e526 >2013-12-04 06:03:46,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6badffce >2013-12-04 06:03:46,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c8edb52, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a702303}, log id: 6badffce >2013-12-04 06:03:51,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: aff31e6 >2013-12-04 06:03:52,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: aff31e6 >2013-12-04 06:03:52,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39df7413 >2013-12-04 06:03:52,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e23563d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53855a67}, log id: 39df7413 >2013-12-04 06:03:52,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5602dda0 >2013-12-04 06:03:53,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@336b5c1f, log id: 5602dda0 >2013-12-04 06:03:57,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ea35eab >2013-12-04 06:03:58,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ea35eab >2013-12-04 06:03:58,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3ad099df >2013-12-04 06:03:58,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2c1c98d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7582a85}, log id: 3ad099df >2013-12-04 06:04:02,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-1) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: d8574f7 >2013-12-04 06:04:03,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-1) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@20714319, log id: d8574f7 >2013-12-04 06:04:03,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5557f650 >2013-12-04 06:04:03,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5557f650 >2013-12-04 06:04:03,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 42863040 >2013-12-04 06:04:04,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@439879b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f5b7399}, log id: 42863040 >2013-12-04 06:04:05,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 47d9658 >2013-12-04 06:04:05,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4ed811f6, log id: 47d9658 >2013-12-04 06:04:05,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4b8355ea >2013-12-04 06:04:06,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7a2e0814, log id: 4b8355ea >2013-12-04 06:04:09,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4cafea31 >2013-12-04 06:04:09,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4cafea31 >2013-12-04 06:04:09,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43d2e5f8 >2013-12-04 06:04:10,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d811ff2e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b887c723}, log id: 43d2e5f8 >2013-12-04 06:04:12,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d7881d4 >2013-12-04 06:04:13,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@76414310, log id: d7881d4 >2013-12-04 06:04:15,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a46fff9 >2013-12-04 06:04:15,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a46fff9 >2013-12-04 06:04:15,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41e725ef >2013-12-04 06:04:16,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9517885d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28b767b9}, log id: 41e725ef >2013-12-04 06:04:21,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 26326fb5 >2013-12-04 06:04:21,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26326fb5 >2013-12-04 06:04:21,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4a665abe >2013-12-04 06:04:21,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38605ef6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b03d1926}, log id: 4a665abe >2013-12-04 06:04:22,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71d5d93e >2013-12-04 06:04:23,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@4c44e90c, log id: 71d5d93e >2013-12-04 06:04:26,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7bffba14 >2013-12-04 06:04:27,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7bffba14 >2013-12-04 06:04:27,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 76d90c0e >2013-12-04 06:04:27,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbcf8f44, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b95680b}, log id: 76d90c0e >2013-12-04 06:04:32,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4eee1004 >2013-12-04 06:04:32,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 55abf5df >2013-12-04 06:04:33,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@107a2e3b, log id: 55abf5df >2013-12-04 06:04:33,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4eee1004 >2013-12-04 06:04:33,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38436150 >2013-12-04 06:04:33,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5c8d7b4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec4d715a}, log id: 38436150 >2013-12-04 06:04:38,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 35a994fc >2013-12-04 06:04:39,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 35a994fc >2013-12-04 06:04:39,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7628c813 >2013-12-04 06:04:39,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bb7cf28, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@717ad93e}, log id: 7628c813 >2013-12-04 06:04:42,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f4ab666 >2013-12-04 06:04:43,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@289bbe73, log id: 6f4ab666 >2013-12-04 06:04:44,250 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) No up server in cluster >2013-12-04 06:04:44,250 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:04:44,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 72cd1778 >2013-12-04 06:04:44,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 240a6284 >2013-12-04 06:04:44,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@d1395396], log id: 72cd1778 >2013-12-04 06:04:45,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 240a6284 >2013-12-04 06:04:45,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3af919e6 >2013-12-04 06:04:45,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c71c68c8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@680a829d}, log id: 3af919e6 >2013-12-04 06:04:50,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: eac4138 >2013-12-04 06:04:51,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: eac4138 >2013-12-04 06:04:51,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b0cf44e >2013-12-04 06:04:51,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2caaeca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed1a8d3d}, log id: 6b0cf44e >2013-12-04 06:04:52,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7222c029 >2013-12-04 06:04:53,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@1173b200, log id: 7222c029 >2013-12-04 06:04:56,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4a09a466 >2013-12-04 06:04:56,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a09a466 >2013-12-04 06:04:56,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7091eeda >2013-12-04 06:04:57,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@584de061, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1a2b3ce}, log id: 7091eeda >2013-12-04 06:05:02,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 65cf81d5 >2013-12-04 06:05:02,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 65cf81d5 >2013-12-04 06:05:02,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: fdfc755 >2013-12-04 06:05:02,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f7c2e59 >2013-12-04 06:05:03,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@674097ed, log id: 5f7c2e59 >2013-12-04 06:05:03,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@393e28b1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c571f2e9}, log id: fdfc755 >2013-12-04 06:05:08,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 444f8a36 >2013-12-04 06:05:08,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 444f8a36 >2013-12-04 06:05:08,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 751af0ed >2013-12-04 06:05:08,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33c59cc4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5ab221e}, log id: 751af0ed >2013-12-04 06:05:12,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5bf34784 >2013-12-04 06:05:13,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@48df38af, log id: 5bf34784 >2013-12-04 06:05:13,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6fce10b4 >2013-12-04 06:05:14,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6fce10b4 >2013-12-04 06:05:14,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d2423a0 >2013-12-04 06:05:14,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@debc45ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70397169}, log id: 2d2423a0 >2013-12-04 06:05:19,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7260b2f2 >2013-12-04 06:05:20,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7260b2f2 >2013-12-04 06:05:20,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 471a24c2 >2013-12-04 06:05:20,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7160e8ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca9cfb3}, log id: 471a24c2 >2013-12-04 06:05:22,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 286648a9 >2013-12-04 06:05:23,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@57e204e8, log id: 286648a9 >2013-12-04 06:05:25,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 72d6599b >2013-12-04 06:05:26,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72d6599b >2013-12-04 06:05:26,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 715448ba >2013-12-04 06:05:26,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6fa7ae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1654ae03}, log id: 715448ba >2013-12-04 06:05:31,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 651eb696 >2013-12-04 06:05:32,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 651eb696 >2013-12-04 06:05:32,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7637a77e >2013-12-04 06:05:32,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f80abf4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7421b162}, log id: 7637a77e >2013-12-04 06:05:32,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3a7ac6eb >2013-12-04 06:05:33,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@4c15ac58, log id: 3a7ac6eb >2013-12-04 06:05:37,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7abbd7a >2013-12-04 06:05:37,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7abbd7a >2013-12-04 06:05:37,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2b54267c >2013-12-04 06:05:38,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a21cf2e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78a85f97}, log id: 2b54267c >2013-12-04 06:05:42,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 552e962d >2013-12-04 06:05:43,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@43ed02bf, log id: 552e962d >2013-12-04 06:05:43,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 699201b8 >2013-12-04 06:05:43,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 699201b8 >2013-12-04 06:05:43,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7b31650a >2013-12-04 06:05:44,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6707aee0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8646e8dc}, log id: 7b31650a >2013-12-04 06:05:44,823 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-04 06:05:44,823 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:05:44,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 30e63025 >2013-12-04 06:05:45,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@cb22a950], log id: 30e63025 >2013-12-04 06:05:49,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5fbcfdc3 >2013-12-04 06:05:49,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fbcfdc3 >2013-12-04 06:05:49,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 740a86de >2013-12-04 06:05:49,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c43f088, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea83b1eb}, log id: 740a86de >2013-12-04 06:05:52,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: f352c55 >2013-12-04 06:05:53,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@643a5e5c, log id: f352c55 >2013-12-04 06:05:55,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2cc83e8a >2013-12-04 06:05:55,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2cc83e8a >2013-12-04 06:05:55,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 533acd06 >2013-12-04 06:05:55,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51387bce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bb71a29}, log id: 533acd06 >2013-12-04 06:06:00,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f84dd99 >2013-12-04 06:06:01,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3f84dd99 >2013-12-04 06:06:01,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 71e640d6 >2013-12-04 06:06:01,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7d1834c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4da5fde2}, log id: 71e640d6 >2013-12-04 06:06:02,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a6b3241 >2013-12-04 06:06:03,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@7760680c, log id: 7a6b3241 >2013-12-04 06:06:06,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 111dc761 >2013-12-04 06:06:07,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 111dc761 >2013-12-04 06:06:07,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1b7656b9 >2013-12-04 06:06:07,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f17b3e40, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38bc020}, log id: 1b7656b9 >2013-12-04 06:06:12,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 288a7a89 >2013-12-04 06:06:12,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 246399c8 >2013-12-04 06:06:13,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@4f0d2c12, log id: 246399c8 >2013-12-04 06:06:13,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 288a7a89 >2013-12-04 06:06:13,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 65c115e4 >2013-12-04 06:06:13,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@919b35db, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87e18569}, log id: 65c115e4 >2013-12-04 06:06:18,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5586a5a5 >2013-12-04 06:06:19,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5586a5a5 >2013-12-04 06:06:19,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2f95eae7 >2013-12-04 06:06:19,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f85c775e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@509e791c}, log id: 2f95eae7 >2013-12-04 06:06:22,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 76db6e8 >2013-12-04 06:06:23,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@1b202121, log id: 76db6e8 >2013-12-04 06:06:24,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 392f61a2 >2013-12-04 06:06:24,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 392f61a2 >2013-12-04 06:06:24,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3045d4e9 >2013-12-04 06:06:25,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fefbcbe0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53b960ca}, log id: 3045d4e9 >2013-12-04 06:06:30,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 12d6bfe4 >2013-12-04 06:06:30,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 12d6bfe4 >2013-12-04 06:06:30,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: d8cde32 >2013-12-04 06:06:31,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d651389, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a72047b}, log id: d8cde32 >2013-12-04 06:06:32,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5063a578 >2013-12-04 06:06:33,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@42d6712c, log id: 5063a578 >2013-12-04 06:06:36,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 463889cc >2013-12-04 06:06:36,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 463889cc >2013-12-04 06:06:36,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 31f7be33 >2013-12-04 06:06:36,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6db1eb1c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5cab8b9}, log id: 31f7be33 >2013-12-04 06:06:41,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 626a2d4c >2013-12-04 06:06:42,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 626a2d4c >2013-12-04 06:06:42,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ad4e49a >2013-12-04 06:06:42,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51695a06, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0f8dfa}, log id: 2ad4e49a >2013-12-04 06:06:42,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5d52b736 >2013-12-04 06:06:43,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@59fcb140, log id: 5d52b736 >2013-12-04 06:06:45,427 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-04 06:06:45,428 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:06:45,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 314bf2c8 >2013-12-04 06:06:46,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@642aae43], log id: 314bf2c8 >2013-12-04 06:06:47,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24a9ae9d >2013-12-04 06:06:48,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 24a9ae9d >2013-12-04 06:06:48,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d30acc >2013-12-04 06:06:48,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86875a8e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c5aaa53}, log id: 6d30acc >2013-12-04 06:06:52,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-3) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 554df162 >2013-12-04 06:06:53,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-3) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@7b24be96, log id: 554df162 >2013-12-04 06:06:53,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7b749471 >2013-12-04 06:06:54,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b749471 >2013-12-04 06:06:54,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ac9e417 >2013-12-04 06:06:54,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9015f09, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ae14e2b}, log id: 6ac9e417 >2013-12-04 06:06:59,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20595fd7 >2013-12-04 06:07:00,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 20595fd7 >2013-12-04 06:07:00,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 21ec8561 >2013-12-04 06:07:00,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7aa42105, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@542b626e}, log id: 21ec8561 >2013-12-04 06:07:02,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: e88271e >2013-12-04 06:07:03,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-13) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@603b6b43, log id: e88271e >2013-12-04 06:07:05,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b3d1bfa >2013-12-04 06:07:06,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b3d1bfa >2013-12-04 06:07:06,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6edb8e2b >2013-12-04 06:07:06,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d998477, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b059bc15}, log id: 6edb8e2b >2013-12-04 06:07:11,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71a7347c >2013-12-04 06:07:11,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 71a7347c >2013-12-04 06:07:11,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57cef758 >2013-12-04 06:07:12,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@677dcbdf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e77e77f3}, log id: 57cef758 >2013-12-04 06:07:12,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4317b7d0 >2013-12-04 06:07:13,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@5a317144, log id: 4317b7d0 >2013-12-04 06:07:17,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 38692cac >2013-12-04 06:07:17,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38692cac >2013-12-04 06:07:17,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4ba4e1 >2013-12-04 06:07:18,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa6138dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c91d1d45}, log id: 4ba4e1 >2013-12-04 06:07:23,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3ea9d442 >2013-12-04 06:07:23,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ea9d442 >2013-12-04 06:07:23,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 61633aa5 >2013-12-04 06:07:23,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51cc095b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44a93f23}, log id: 61633aa5 >2013-12-04 06:07:28,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6939bfdf >2013-12-04 06:07:29,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6939bfdf >2013-12-04 06:07:29,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 495c9756 >2013-12-04 06:07:29,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f210824, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad20c505}, log id: 495c9756 >2013-12-04 06:07:34,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 31dcd73 >2013-12-04 06:07:35,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31dcd73 >2013-12-04 06:07:35,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 135c886c >2013-12-04 06:07:35,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95f9d60a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b70f4fb2}, log id: 135c886c >2013-12-04 06:07:40,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5119a192 >2013-12-04 06:07:41,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5119a192 >2013-12-04 06:07:41,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1b052e0a >2013-12-04 06:07:41,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@610d0b4d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a5f8390}, log id: 1b052e0a >2013-12-04 06:07:46,060 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) No up server in cluster >2013-12-04 06:07:46,061 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:07:46,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f819d16 >2013-12-04 06:07:46,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1fba36c8 >2013-12-04 06:07:46,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@a96b896], log id: 7f819d16 >2013-12-04 06:07:47,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1fba36c8 >2013-12-04 06:07:47,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 268e1718 >2013-12-04 06:07:47,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@516a5b07, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2223eaba}, log id: 268e1718 >2013-12-04 06:07:52,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4690ef79 >2013-12-04 06:07:52,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4690ef79 >2013-12-04 06:07:52,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a06c1d5 >2013-12-04 06:07:53,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cabacfc7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@769609d0}, log id: 1a06c1d5 >2013-12-04 06:07:58,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1c641f62 >2013-12-04 06:07:58,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c641f62 >2013-12-04 06:07:58,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4d721506 >2013-12-04 06:07:59,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d005f04, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dd866ba}, log id: 4d721506 >2013-12-04 06:08:04,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 260f67be >2013-12-04 06:08:04,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 260f67be >2013-12-04 06:08:04,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fc2b4b3 >2013-12-04 06:08:04,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@843240c4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c73213e5}, log id: 2fc2b4b3 >2013-12-04 06:08:09,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3e6ac117 >2013-12-04 06:08:10,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e6ac117 >2013-12-04 06:08:10,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 20d0a678 >2013-12-04 06:08:10,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c957bded, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50ec6e39}, log id: 20d0a678 >2013-12-04 06:08:15,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11b4f058 >2013-12-04 06:08:16,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 11b4f058 >2013-12-04 06:08:16,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7467775b >2013-12-04 06:08:16,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f9cc8aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1776e611}, log id: 7467775b >2013-12-04 06:08:21,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1dbf988f >2013-12-04 06:08:22,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dbf988f >2013-12-04 06:08:22,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 25bdbfb1 >2013-12-04 06:08:22,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dfecdf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a34b1c32}, log id: 25bdbfb1 >2013-12-04 06:08:27,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6effdcd1 >2013-12-04 06:08:28,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6effdcd1 >2013-12-04 06:08:28,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f81f415 >2013-12-04 06:08:28,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@513f2424, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb4c27a5}, log id: 1f81f415 >2013-12-04 06:08:33,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 615e8038 >2013-12-04 06:08:34,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 615e8038 >2013-12-04 06:08:34,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d8b82dd >2013-12-04 06:08:34,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1691a615, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2584a36c}, log id: d8b82dd >2013-12-04 06:08:39,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 763b30f7 >2013-12-04 06:08:39,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 763b30f7 >2013-12-04 06:08:39,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1802cf0b >2013-12-04 06:08:40,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e2f368e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b861ed4e}, log id: 1802cf0b >2013-12-04 06:08:45,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 53467778 >2013-12-04 06:08:45,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 53467778 >2013-12-04 06:08:45,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 51b3d29c >2013-12-04 06:08:45,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3d03dcc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74e99030}, log id: 51b3d29c >2013-12-04 06:08:46,683 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-04 06:08:46,684 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:08:46,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 207343c >2013-12-04 06:08:47,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@61d8de4], log id: 207343c >2013-12-04 06:08:47,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-9) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4206aac6 >2013-12-04 06:08:47,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-9) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@3689727b, log id: 4206aac6 >2013-12-04 06:08:51,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3456c174 >2013-12-04 06:08:51,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3456c174 >2013-12-04 06:08:51,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b792861 >2013-12-04 06:08:51,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@846a416f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a90da0}, log id: 5b792861 >2013-12-04 06:08:56,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5ad3ee6 >2013-12-04 06:08:57,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ad3ee6 >2013-12-04 06:08:57,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 77d134f8 >2013-12-04 06:08:57,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8e7431d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a55ff61a}, log id: 77d134f8 >2013-12-04 06:09:00,509 INFO [org.ovirt.engine.core.bll.gluster.CommitRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-4) [34ca179b] Running command: CommitRemoveGlusterVolumeBricksCommand internal: false. Entities affected : ID: dbfbcab7-6ec2-4bed-89de-aef7e409e97c Type: GlusterVolume >2013-12-04 06:09:00,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.CommitRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-4) [34ca179b] START, CommitRemoveGlusterVolumeBricksVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d1b88f7 >2013-12-04 06:09:02,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: c7daa6 >2013-12-04 06:09:05,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c7daa6 >2013-12-04 06:09:05,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1eccb712 >2013-12-04 06:09:05,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@505e8629, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c7042a2}, log id: 1eccb712 >2013-12-04 06:09:06,100 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-40) Detected brick 10.70.37.155:/rhs/brick4/b2 removed from Volume dis_rep_vol. Removing it from engine DB as well. >2013-12-04 06:09:06,101 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-28) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 06:09:06,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.CommitRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-4) [34ca179b] FINISH, CommitRemoveGlusterVolumeBricksVDSCommand, log id: 3d1b88f7 >2013-12-04 06:09:06,299 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-40) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected brick 10.70.37.155:/rhs/brick4/b2 removed from Volume dis_rep_vol of cluster test, and removed it from engine DB. >2013-12-04 06:09:06,299 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-40) Detected brick 10.70.37.147:/rhs/brick4/b2 removed from Volume dis_rep_vol. Removing it from engine DB as well. >2013-12-04 06:09:06,303 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-40) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected brick 10.70.37.147:/rhs/brick4/b2 removed from Volume dis_rep_vol of cluster test, and removed it from engine DB. >2013-12-04 06:09:06,349 INFO [org.ovirt.engine.core.bll.gluster.CommitRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-4) [34ca179b] Lock freed to object EngineLock [exclusiveLocks= key: dbfbcab7-6ec2-4bed-89de-aef7e409e97c value: GLUSTER >, sharedLocks= ] >2013-12-04 06:09:06,350 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-28) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 06:09:06,359 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [34ca179b] Correlation ID: 34ca179b, Call Stack: null, Custom Event ID: -1, Message: Gluster volume remove bricks committed >2013-12-04 06:09:06,473 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-40) Brick order for brick 10.70.37.74:/rhs/brick5/b3 changed from 2 to 0 because of direct CLI operations. Updating engine DB accordingly. >2013-12-04 06:09:06,476 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-40) Brick order for brick 10.70.37.118:/rhs/brick5/b3 changed from 3 to 1 because of direct CLI operations. Updating engine DB accordingly. >2013-12-04 06:09:06,484 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-40) Brick order for brick 10.70.37.74:/rhs/brick4/b1 changed from 4 to 2 because of direct CLI operations. Updating engine DB accordingly. >2013-12-04 06:09:06,486 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-40) Brick order for brick 10.70.37.118:/rhs/brick4/b1 changed from 5 to 3 because of direct CLI operations. Updating engine DB accordingly. >2013-12-04 06:09:06,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b33e360 >2013-12-04 06:09:06,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4d7ec926, log id: 1b33e360 >2013-12-04 06:09:06,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3ec80589 >2013-12-04 06:09:07,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@732c7007, log id: 3ec80589 >2013-12-04 06:09:11,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 285fbd5c >2013-12-04 06:09:12,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 285fbd5c >2013-12-04 06:09:12,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1cf71183 >2013-12-04 06:09:12,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9b19de1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be3e513b}, log id: 1cf71183 >2013-12-04 06:09:17,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34887cfd >2013-12-04 06:09:17,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 34887cfd >2013-12-04 06:09:17,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: ed2a068 >2013-12-04 06:09:18,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c60e796e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1f9ac1a}, log id: ed2a068 >2013-12-04 06:09:23,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e59619f >2013-12-04 06:09:23,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e59619f >2013-12-04 06:09:23,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 24345998 >2013-12-04 06:09:23,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43ab5790, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc91046f}, log id: 24345998 >2013-12-04 06:09:29,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1577dc3 >2013-12-04 06:09:29,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1577dc3 >2013-12-04 06:09:29,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 31822080 >2013-12-04 06:09:29,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f620ec7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2dc1c8b}, log id: 31822080 >2013-12-04 06:09:34,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 72043083 >2013-12-04 06:09:35,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 72043083 >2013-12-04 06:09:35,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4ac26451 >2013-12-04 06:09:35,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca1fdc29, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@289c996c}, log id: 4ac26451 >2013-12-04 06:09:40,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6190b1be >2013-12-04 06:09:41,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:DISCONNECTED, 10.70.37.118:CONNECTED], log id: 6190b1be >2013-12-04 06:09:41,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 673e5de0 >2013-12-04 06:09:41,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e1798fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71f3603a}, log id: 673e5de0 >2013-12-04 06:09:46,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 504bce60 >2013-12-04 06:09:46,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, log id: 504bce60 >2013-12-04 06:09:46,811 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-56) Gluster servers list failed in server host1 moving it to NonOperational >2013-12-04 06:09:46,820 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-56) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to fetch gluster peer list from server host1 on Cluster test. >2013-12-04 06:09:46,844 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-56) [3990c61e] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 06:09:46,846 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-56) [3990c61e] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, status=NonOperational, nonOperationalReason=GLUSTER_COMMAND_FAILED), log id: 54806c31 >2013-12-04 06:09:46,849 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-56) [3990c61e] FINISH, SetVdsStatusVDSCommand, log id: 54806c31 >2013-12-04 06:09:46,880 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-56) [3990c61e] Correlation ID: 3990c61e, Job ID: 36446b70-89fe-4668-b6b3-3c7f0cb666d8, Call Stack: null, Custom Event ID: -1, Message: Gluster command [gluster peer status] failed on server host1. >2013-12-04 06:09:46,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [3990c61e] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7cc7bb2c >2013-12-04 06:09:47,280 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) No up server in cluster >2013-12-04 06:09:47,283 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:09:47,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4293aa85 >2013-12-04 06:09:47,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [3990c61e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 7cc7bb2c >2013-12-04 06:09:47,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [3990c61e] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3a72c786 >2013-12-04 06:09:47,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4293aa85 >2013-12-04 06:09:47,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [3990c61e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a72c786 >2013-12-04 06:09:47,659 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-56) [3990c61e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to fetch gluster volume list from server host1. >2013-12-04 06:09:47,672 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 06:09:47,674 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, status=NonOperational, nonOperationalReason=GLUSTER_COMMAND_FAILED), log id: 41ef83b9 >2013-12-04 06:09:47,677 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, SetVdsStatusVDSCommand, log id: 41ef83b9 >2013-12-04 06:09:47,744 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-56) [49a6fca1] Correlation ID: 49a6fca1, Job ID: 6f41c82b-fc1d-4f48-be9d-65fea39f8d69, Call Stack: null, Custom Event ID: -1, Message: Gluster command [gluster peer status] failed on server host1. >2013-12-04 06:09:47,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2c2f4429 >2013-12-04 06:09:48,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@651e5584, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de1a58e}, log id: 2c2f4429 >2013-12-04 06:09:49,304 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-17) [684310ce] Lock Acquired to object EngineLock [exclusiveLocks= key: be2c16f2-a173-4bac-a979-47cf211a97e3 value: GLUSTER >, sharedLocks= ] >2013-12-04 06:09:49,312 WARN [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-17) [684310ce] CanDoAction of action StartRemoveGlusterVolumeBricks failed. Reasons:$volumeName dis_vol,$vdsGroup test,VAR__ACTION__REMOVE_BRICKS_START,VAR__TYPE__GLUSTER_BRICK,ACTION_TYPE_FAILED_ONE_OR_MORE_BRICKS_ARE_DOWN >2013-12-04 06:09:49,312 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-17) [684310ce] Lock freed to object EngineLock [exclusiveLocks= key: be2c16f2-a173-4bac-a979-47cf211a97e3 value: GLUSTER >, sharedLocks= ] >2013-12-04 06:09:53,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 60fd2f83 >2013-12-04 06:09:53,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:DISCONNECTED, 10.70.37.118:CONNECTED], log id: 60fd2f83 >2013-12-04 06:09:53,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3c511edf >2013-12-04 06:09:53,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f94e109, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fb50398}, log id: 3c511edf >2013-12-04 06:09:58,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53f5f8f8 >2013-12-04 06:09:59,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 53f5f8f8 >2013-12-04 06:09:59,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 76a90a7c >2013-12-04 06:09:59,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ab1c52d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@503172e}, log id: 76a90a7c >2013-12-04 06:10:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [1125b869] Autorecovering 1 hosts >2013-12-04 06:10:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [1125b869] Autorecovering hosts id: 4c17e50e-8225-48c6-bcb3-bfba4ec37037, name : host1 >2013-12-04 06:10:00,025 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-30) [14494cf2] Lock Acquired to object EngineLock [exclusiveLocks= key: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 value: VDS >, sharedLocks= ] >2013-12-04 06:10:00,030 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-30) [14494cf2] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 06:10:00,031 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-30) [14494cf2] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2013-12-04 06:10:00,031 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-30) [14494cf2] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2013-12-04 06:10:00,040 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-30) [14494cf2] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, status=Unassigned, nonOperationalReason=NONE), log id: 78448c42 >2013-12-04 06:10:00,044 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-30) [14494cf2] FINISH, SetVdsStatusVDSCommand, log id: 78448c42 >2013-12-04 06:10:00,046 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-30) [14494cf2] START, ActivateVdsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79c5f009 >2013-12-04 06:10:00,220 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-30) [14494cf2] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, vds=Host[host1]), log id: 2709bb01 >2013-12-04 06:10:00,235 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-30) [14494cf2] FINISH, GetHardwareInfoVDSCommand, log id: 2709bb01 >2013-12-04 06:10:00,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [14494cf2] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4cfa54ef >2013-12-04 06:10:04,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2a1d0fb >2013-12-04 06:10:05,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a1d0fb >2013-12-04 06:10:05,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 569c822b >2013-12-04 06:10:05,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b727b28, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bb0490b}, log id: 569c822b >2013-12-04 06:10:08,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [14494cf2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4cfa54ef >2013-12-04 06:10:08,400 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 06:10:08,431 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 79c5f009 >2013-12-04 06:10:08,573 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2013-12-04 06:10:08,690 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-30) [e67de57] Correlation ID: 14494cf2, Call Stack: null, Custom Event ID: -1, Message: Host host1 was autorecovered. >2013-12-04 06:10:08,690 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] Lock freed to object EngineLock [exclusiveLocks= key: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 value: VDS >, sharedLocks= ] >2013-12-04 06:10:10,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53c9fa93 >2013-12-04 06:10:10,680 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, vds=Host[host1]), log id: 57ac9301 >2013-12-04 06:10:10,693 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GetHardwareInfoVDSCommand, log id: 57ac9301 >2013-12-04 06:10:10,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6cb0407 >2013-12-04 06:10:11,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 53c9fa93 >2013-12-04 06:10:11,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7adbaa44 >2013-12-04 06:10:11,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6cb0407 >2013-12-04 06:10:11,190 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-69) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host host1. >2013-12-04 06:10:11,211 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-69) [ab3b16f] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 5849b030-626e-47cb-ad90-3ce782d831b3 Type: StoragePool >2013-12-04 06:10:11,227 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-69) [ab3b16f] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 06:10:11,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8558128, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd7562ce}, log id: 7adbaa44 >2013-12-04 06:10:11,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [ab3b16f] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2cd661ab >2013-12-04 06:10:11,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [ab3b16f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cd661ab >2013-12-04 06:10:11,934 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 06:10:16,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 602482aa >2013-12-04 06:10:16,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 602482aa >2013-12-04 06:10:16,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2233557 >2013-12-04 06:10:17,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c40f0637, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfb52fae}, log id: 2233557 >2013-12-04 06:10:22,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4a4daa38 >2013-12-04 06:10:22,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a4daa38 >2013-12-04 06:10:22,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c18f408 >2013-12-04 06:10:23,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31bb3f9d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c14f1faa}, log id: 1c18f408 >2013-12-04 06:10:28,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1fcafa13 >2013-12-04 06:10:28,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1fcafa13 >2013-12-04 06:10:28,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 12792ad9 >2013-12-04 06:10:28,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af5929a4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ff63855}, log id: 12792ad9 >2013-12-04 06:10:33,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c3f9475 >2013-12-04 06:10:34,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c3f9475 >2013-12-04 06:10:34,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 227ee312 >2013-12-04 06:10:34,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a73c9c8b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2f719d}, log id: 227ee312 >2013-12-04 06:10:39,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 197f7171 >2013-12-04 06:10:40,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 197f7171 >2013-12-04 06:10:40,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f3a3dd9 >2013-12-04 06:10:40,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f17593b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d2364ad}, log id: f3a3dd9 >2013-12-04 06:10:45,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 736e6465 >2013-12-04 06:10:46,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 736e6465 >2013-12-04 06:10:46,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 66a73e1c >2013-12-04 06:10:46,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72f6d721, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@239c2c1e}, log id: 66a73e1c >2013-12-04 06:10:47,586 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-04 06:10:47,586 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:10:47,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 690c3f69 >2013-12-04 06:10:47,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 690c3f69 >2013-12-04 06:10:51,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4696927c >2013-12-04 06:10:51,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4696927c >2013-12-04 06:10:51,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: dc09e53 >2013-12-04 06:10:52,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3368a137, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1f9fce4}, log id: dc09e53 >2013-12-04 06:10:57,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 76d3cdb5 >2013-12-04 06:10:57,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 76d3cdb5 >2013-12-04 06:10:57,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a2ae8ef >2013-12-04 06:10:58,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c866723f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e80c305e}, log id: 6a2ae8ef >2013-12-04 06:11:03,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 752ac8b6 >2013-12-04 06:11:03,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 752ac8b6 >2013-12-04 06:11:03,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1e6b4426 >2013-12-04 06:11:03,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3011e441, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e48f91f}, log id: 1e6b4426 >2013-12-04 06:11:08,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7920f9e9 >2013-12-04 06:11:09,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7920f9e9 >2013-12-04 06:11:09,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 777016af >2013-12-04 06:11:09,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b3fe341, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da5fa1cd}, log id: 777016af >2013-12-04 06:11:14,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5ced0b >2013-12-04 06:11:15,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ced0b >2013-12-04 06:11:15,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32571cfd >2013-12-04 06:11:15,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98435c62, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f1944d}, log id: 32571cfd >2013-12-04 06:11:20,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61b62ada >2013-12-04 06:11:21,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 61b62ada >2013-12-04 06:11:21,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 164690e1 >2013-12-04 06:11:21,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@711cdb8b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@783e2ae6}, log id: 164690e1 >2013-12-04 06:11:26,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 419d67ee >2013-12-04 06:11:26,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 419d67ee >2013-12-04 06:11:26,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 369c526e >2013-12-04 06:11:27,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ceb68b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f61e1f0b}, log id: 369c526e >2013-12-04 06:11:32,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6928a6e9 >2013-12-04 06:11:32,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6928a6e9 >2013-12-04 06:11:32,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4e73c57c >2013-12-04 06:11:33,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@748d76cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28379112}, log id: 4e73c57c >2013-12-04 06:11:38,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5b99c0ec >2013-12-04 06:11:38,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b99c0ec >2013-12-04 06:11:38,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 661f2ad9 >2013-12-04 06:11:38,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e167077, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3857adbd}, log id: 661f2ad9 >2013-12-04 06:11:43,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ea3e486 >2013-12-04 06:11:44,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ea3e486 >2013-12-04 06:11:44,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 504cee32 >2013-12-04 06:11:44,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@907ab59, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@822951ee}, log id: 504cee32 >2013-12-04 06:11:47,911 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) [e67de57] No up server in cluster >2013-12-04 06:11:47,912 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) [e67de57] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:11:47,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 261e08b3 >2013-12-04 06:11:48,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterTasksListVDSCommand, return: [], log id: 261e08b3 >2013-12-04 06:11:49,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2131cc95 >2013-12-04 06:11:50,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2131cc95 >2013-12-04 06:11:50,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 855d94f >2013-12-04 06:11:50,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d168fa4c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@804590e6}, log id: 855d94f >2013-12-04 06:11:55,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6f46aa00 >2013-12-04 06:11:56,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f46aa00 >2013-12-04 06:11:56,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 487a3441 >2013-12-04 06:11:56,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45be6cda, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@781e467}, log id: 487a3441 >2013-12-04 06:12:01,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 23b54a5f >2013-12-04 06:12:01,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 23b54a5f >2013-12-04 06:12:01,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 50c6e255 >2013-12-04 06:12:02,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64fc2b17, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c7d0f72}, log id: 50c6e255 >2013-12-04 06:12:07,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1f5a5756 >2013-12-04 06:12:07,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1f5a5756 >2013-12-04 06:12:07,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ef7aec5 >2013-12-04 06:12:07,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5acf151, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1c1f95a}, log id: 5ef7aec5 >2013-12-04 06:12:12,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 787741fe >2013-12-04 06:12:13,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 787741fe >2013-12-04 06:12:13,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6b160fb9 >2013-12-04 06:12:13,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4502d90f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e35c2c2}, log id: 6b160fb9 >2013-12-04 06:12:18,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 491598ec >2013-12-04 06:12:19,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 491598ec >2013-12-04 06:12:19,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 50b615d8 >2013-12-04 06:12:19,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e466a6d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9203a2fe}, log id: 50b615d8 >2013-12-04 06:12:24,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a0873d8 >2013-12-04 06:12:25,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4a0873d8 >2013-12-04 06:12:25,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d27b653 >2013-12-04 06:12:25,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd5ed984, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51211ba1}, log id: 2d27b653 >2013-12-04 06:12:30,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 314a0de7 >2013-12-04 06:12:31,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 314a0de7 >2013-12-04 06:12:31,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 582c4831 >2013-12-04 06:12:31,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71e9132c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aac325ab}, log id: 582c4831 >2013-12-04 06:12:36,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 794cd562 >2013-12-04 06:12:36,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 794cd562 >2013-12-04 06:12:36,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20ad6142 >2013-12-04 06:12:37,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d1a19f1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2fcbef6}, log id: 20ad6142 >2013-12-04 06:12:42,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3242c2f4 >2013-12-04 06:12:42,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3242c2f4 >2013-12-04 06:12:42,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 8fcc00c >2013-12-04 06:12:42,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffd653b1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32658444}, log id: 8fcc00c >2013-12-04 06:12:48,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 65f42a7f >2013-12-04 06:12:48,233 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) No up server in cluster >2013-12-04 06:12:48,234 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:12:48,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 305375cb >2013-12-04 06:12:48,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterTasksListVDSCommand, return: [], log id: 305375cb >2013-12-04 06:12:48,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65f42a7f >2013-12-04 06:12:48,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 54f0b1f9 >2013-12-04 06:12:48,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73844bc0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c01043cb}, log id: 54f0b1f9 >2013-12-04 06:12:53,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1c155ba2 >2013-12-04 06:12:54,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c155ba2 >2013-12-04 06:12:54,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2efb6fa4 >2013-12-04 06:12:54,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7aa8e418, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b1f7c1}, log id: 2efb6fa4 >2013-12-04 06:12:59,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 376e14b2 >2013-12-04 06:13:00,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 376e14b2 >2013-12-04 06:13:00,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 77de30ad >2013-12-04 06:13:00,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c70fbefb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3692c86c}, log id: 77de30ad >2013-12-04 06:13:05,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 69d11a16 >2013-12-04 06:13:05,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 69d11a16 >2013-12-04 06:13:05,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 498d137e >2013-12-04 06:13:06,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90950e92, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7f73d96}, log id: 498d137e >2013-12-04 06:13:11,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e22a7a1 >2013-12-04 06:13:11,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7e22a7a1 >2013-12-04 06:13:11,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 50e84b02 >2013-12-04 06:13:12,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fdf07d1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d29d1791}, log id: 50e84b02 >2013-12-04 06:13:17,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 28951499 >2013-12-04 06:13:17,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 28951499 >2013-12-04 06:13:17,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ffb6b93 >2013-12-04 06:13:17,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6405783, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f95c5216}, log id: 2ffb6b93 >2013-12-04 06:13:22,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 17f1f199 >2013-12-04 06:13:23,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 17f1f199 >2013-12-04 06:13:23,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d482092 >2013-12-04 06:13:23,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1f6b203, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3be8ed29}, log id: 6d482092 >2013-12-04 06:13:28,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79361a6e >2013-12-04 06:13:29,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 79361a6e >2013-12-04 06:13:29,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 190c60ea >2013-12-04 06:13:29,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99603d9f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b70449c2}, log id: 190c60ea >2013-12-04 06:13:34,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f50cb4d >2013-12-04 06:13:35,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f50cb4d >2013-12-04 06:13:35,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1bfcb95f >2013-12-04 06:13:35,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27f39ed0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78f2d72c}, log id: 1bfcb95f >2013-12-04 06:13:40,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 21526341 >2013-12-04 06:13:40,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 21526341 >2013-12-04 06:13:40,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 74c58df0 >2013-12-04 06:13:41,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6702d46d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3611fd3e}, log id: 74c58df0 >2013-12-04 06:13:46,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 116d6078 >2013-12-04 06:13:46,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 116d6078 >2013-12-04 06:13:46,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2c2014ba >2013-12-04 06:13:47,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74a06ec8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d42cd798}, log id: 2c2014ba >2013-12-04 06:13:48,493 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) No up server in cluster >2013-12-04 06:13:48,493 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:13:48,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d6ff96c >2013-12-04 06:13:48,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4d6ff96c >2013-12-04 06:13:52,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: e625621 >2013-12-04 06:13:52,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e625621 >2013-12-04 06:13:52,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: ffdaa4c >2013-12-04 06:13:52,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a586949, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b83a517}, log id: ffdaa4c >2013-12-04 06:13:57,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28cb65e6 >2013-12-04 06:13:58,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 28cb65e6 >2013-12-04 06:13:58,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5fbcf32 >2013-12-04 06:13:58,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@167ca8b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13851acf}, log id: 5fbcf32 >2013-12-04 06:14:03,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 253b58b >2013-12-04 06:14:04,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 253b58b >2013-12-04 06:14:04,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 77911ce >2013-12-04 06:14:04,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7611c40, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24acc566}, log id: 77911ce >2013-12-04 06:14:07,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: fac476c >2013-12-04 06:14:07,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@400440dd, log id: fac476c >2013-12-04 06:14:07,431 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-33) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected change in status of brick 10.70.37.74:/rhs/brick5/b3 of volume dis_rep_vol from DOWN to UP. >2013-12-04 06:14:07,435 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-33) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected change in status of brick 10.70.37.74:/rhs/brick4/b1 of volume dis_rep_vol from DOWN to UP. >2013-12-04 06:14:07,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7ab0e5af >2013-12-04 06:14:07,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@179d051c, log id: 7ab0e5af >2013-12-04 06:14:07,729 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-33) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected change in status of brick 10.70.37.74:/rhs/brick1/b1 of volume dis_vol from DOWN to UP. >2013-12-04 06:14:09,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66ab4937 >2013-12-04 06:14:10,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 66ab4937 >2013-12-04 06:14:10,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5381051 >2013-12-04 06:14:10,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15bf2277, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e32d942d}, log id: 5381051 >2013-12-04 06:14:15,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: c8c8594 >2013-12-04 06:14:15,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c8c8594 >2013-12-04 06:14:15,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6921c3fd >2013-12-04 06:14:16,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c96a391, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25f0b1a2}, log id: 6921c3fd >2013-12-04 06:14:21,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3dd8f00d >2013-12-04 06:14:21,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3dd8f00d >2013-12-04 06:14:21,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3afac85d >2013-12-04 06:14:22,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63ab1c5a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fac9dc5a}, log id: 3afac85d >2013-12-04 06:14:27,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ed49ba5 >2013-12-04 06:14:27,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4ed49ba5 >2013-12-04 06:14:27,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5b4ae65a >2013-12-04 06:14:27,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aabd3d90, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59b2ef79}, log id: 5b4ae65a >2013-12-04 06:14:32,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 67d0c176 >2013-12-04 06:14:33,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67d0c176 >2013-12-04 06:14:33,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 68673a3 >2013-12-04 06:14:33,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d648e41f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30317f81}, log id: 68673a3 >2013-12-04 06:14:38,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61070c69 >2013-12-04 06:14:39,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 61070c69 >2013-12-04 06:14:39,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e9c4c9d >2013-12-04 06:14:39,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dc304bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5e7b118}, log id: 2e9c4c9d >2013-12-04 06:14:44,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 715933ba >2013-12-04 06:14:44,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 715933ba >2013-12-04 06:14:44,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3530c936 >2013-12-04 06:14:45,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db9e12ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bc24942}, log id: 3530c936 >2013-12-04 06:14:48,795 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-04 06:14:48,795 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:14:48,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 348192a5 >2013-12-04 06:14:49,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 348192a5 >2013-12-04 06:14:50,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54171f39 >2013-12-04 06:14:50,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 54171f39 >2013-12-04 06:14:50,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c5e4422 >2013-12-04 06:14:51,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a11d466, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a7eb6d2}, log id: 5c5e4422 >2013-12-04 06:14:56,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2696472c >2013-12-04 06:14:56,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2696472c >2013-12-04 06:14:56,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 231efdce >2013-12-04 06:14:56,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b1924ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b5b3a96}, log id: 231efdce >2013-12-04 06:15:01,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1879d158 >2013-12-04 06:15:02,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1879d158 >2013-12-04 06:15:02,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e275136 >2013-12-04 06:15:02,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84fe8b62, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51954fb6}, log id: 2e275136 >2013-12-04 06:15:07,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1821feec >2013-12-04 06:15:08,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1821feec >2013-12-04 06:15:08,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 62c60f9c >2013-12-04 06:15:08,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f27bbb57, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b08d6e2}, log id: 62c60f9c >2013-12-04 06:15:13,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1f31a9ca >2013-12-04 06:15:14,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f31a9ca >2013-12-04 06:15:14,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6243cdd3 >2013-12-04 06:15:14,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b7c452b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d782a9b}, log id: 6243cdd3 >2013-12-04 06:15:19,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 62b5b419 >2013-12-04 06:15:19,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62b5b419 >2013-12-04 06:15:19,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 47824896 >2013-12-04 06:15:20,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7eacdad5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c31779d}, log id: 47824896 >2013-12-04 06:15:25,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 33cb2bd2 >2013-12-04 06:15:25,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 33cb2bd2 >2013-12-04 06:15:25,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 501b88b5 >2013-12-04 06:15:25,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0d05603, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9f14c7e}, log id: 501b88b5 >2013-12-04 06:15:30,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55c09bfc >2013-12-04 06:15:31,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 55c09bfc >2013-12-04 06:15:31,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 58f69a93 >2013-12-04 06:15:31,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbafa03d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@580432cd}, log id: 58f69a93 >2013-12-04 06:15:36,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 52ec82ed >2013-12-04 06:15:37,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 52ec82ed >2013-12-04 06:15:37,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2bd608e6 >2013-12-04 06:15:37,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@717ef1f0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19612548}, log id: 2bd608e6 >2013-12-04 06:15:42,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 28cb5ddd >2013-12-04 06:15:43,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28cb5ddd >2013-12-04 06:15:43,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 551c3068 >2013-12-04 06:15:43,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cec219ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbc1d740}, log id: 551c3068 >2013-12-04 06:15:48,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 11ecec1a >2013-12-04 06:15:48,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 11ecec1a >2013-12-04 06:15:48,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 16ca529 >2013-12-04 06:15:49,085 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) No up server in cluster >2013-12-04 06:15:49,085 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:15:49,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 48c7c79 >2013-12-04 06:15:49,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb9cd765, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe7100af}, log id: 16ca529 >2013-12-04 06:15:49,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, return: [], log id: 48c7c79 >2013-12-04 06:15:54,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6145ecbe >2013-12-04 06:15:54,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6145ecbe >2013-12-04 06:15:54,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46dc3b5d >2013-12-04 06:15:55,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edc5dea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5757b643}, log id: 46dc3b5d >2013-12-04 06:16:00,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19906eae >2013-12-04 06:16:00,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 19906eae >2013-12-04 06:16:00,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1976fa51 >2013-12-04 06:16:00,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@203a50ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6bbb98f}, log id: 1976fa51 >2013-12-04 06:16:05,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c5f611 >2013-12-04 06:16:06,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5c5f611 >2013-12-04 06:16:06,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40dad34f >2013-12-04 06:16:06,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96161e46, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6a7025b}, log id: 40dad34f >2013-12-04 06:16:11,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 574cdf36 >2013-12-04 06:16:12,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 574cdf36 >2013-12-04 06:16:12,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73b50a15 >2013-12-04 06:16:12,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2579979, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e34429e1}, log id: 73b50a15 >2013-12-04 06:16:17,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 70c772 >2013-12-04 06:16:18,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70c772 >2013-12-04 06:16:18,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7d431d73 >2013-12-04 06:16:18,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3efbadcd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51fb3afb}, log id: 7d431d73 >2013-12-04 06:16:23,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4f9247d5 >2013-12-04 06:16:23,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f9247d5 >2013-12-04 06:16:23,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f926176 >2013-12-04 06:16:24,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54adb82, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81f5bbb4}, log id: 3f926176 >2013-12-04 06:16:29,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 516abea9 >2013-12-04 06:16:29,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 516abea9 >2013-12-04 06:16:29,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 31d75a95 >2013-12-04 06:16:29,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c37b34c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@817f233a}, log id: 31d75a95 >2013-12-04 06:16:34,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: c699a84 >2013-12-04 06:16:35,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: c699a84 >2013-12-04 06:16:35,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5c2bd3c >2013-12-04 06:16:35,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79595e53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee00b0f}, log id: 5c2bd3c >2013-12-04 06:16:40,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41774659 >2013-12-04 06:16:41,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 41774659 >2013-12-04 06:16:41,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69f91d18 >2013-12-04 06:16:41,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd73d95a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a58b8f30}, log id: 69f91d18 >2013-12-04 06:16:46,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 56b8adc4 >2013-12-04 06:16:47,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 56b8adc4 >2013-12-04 06:16:47,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 26a9d9bb >2013-12-04 06:16:47,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@681b7a13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ec578e2}, log id: 26a9d9bb >2013-12-04 06:16:49,397 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-04 06:16:49,397 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:16:49,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ca66794 >2013-12-04 06:16:49,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: ca66794 >2013-12-04 06:16:52,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 49156c65 >2013-12-04 06:16:52,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 49156c65 >2013-12-04 06:16:52,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29a98337 >2013-12-04 06:16:53,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f489fe5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84d89f61}, log id: 29a98337 >2013-12-04 06:16:58,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74351e03 >2013-12-04 06:16:58,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 74351e03 >2013-12-04 06:16:58,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 15c640a2 >2013-12-04 06:16:58,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a92ef787, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ad5d556}, log id: 15c640a2 >2013-12-04 06:17:04,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 751efb6d >2013-12-04 06:17:04,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 751efb6d >2013-12-04 06:17:04,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b4f98b5 >2013-12-04 06:17:04,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23506e3e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0d37565}, log id: 3b4f98b5 >2013-12-04 06:17:09,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 13cd242b >2013-12-04 06:17:10,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 13cd242b >2013-12-04 06:17:10,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 740674d7 >2013-12-04 06:17:10,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1b60531, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da9a4a54}, log id: 740674d7 >2013-12-04 06:17:15,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ce362ce >2013-12-04 06:17:16,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ce362ce >2013-12-04 06:17:16,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 383e2e47 >2013-12-04 06:17:16,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d380f069, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49131674}, log id: 383e2e47 >2013-12-04 06:17:21,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4303c28b >2013-12-04 06:17:21,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4303c28b >2013-12-04 06:17:21,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 554a3354 >2013-12-04 06:17:22,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@480f03f3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@721f4804}, log id: 554a3354 >2013-12-04 06:17:27,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1c748a98 >2013-12-04 06:17:27,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c748a98 >2013-12-04 06:17:27,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: c400c36 >2013-12-04 06:17:28,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96efc501, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64da1682}, log id: c400c36 >2013-12-04 06:17:33,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2de5db32 >2013-12-04 06:17:33,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2de5db32 >2013-12-04 06:17:33,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e3fc670 >2013-12-04 06:17:33,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17ad6926, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d98f441}, log id: 7e3fc670 >2013-12-04 06:17:38,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 150b1c5c >2013-12-04 06:17:39,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 150b1c5c >2013-12-04 06:17:39,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2acf969f >2013-12-04 06:17:39,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f89e066, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f2c8cee}, log id: 2acf969f >2013-12-04 06:17:44,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5930bf2b >2013-12-04 06:17:45,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5930bf2b >2013-12-04 06:17:45,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a048e64 >2013-12-04 06:17:45,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@231a67bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1322b8a8}, log id: a048e64 >2013-12-04 06:17:49,704 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) [6dd5dead] No up server in cluster >2013-12-04 06:17:49,705 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) [6dd5dead] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:17:49,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5a571550 >2013-12-04 06:17:50,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5a571550 >2013-12-04 06:17:50,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 69cf2a1f >2013-12-04 06:17:51,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 69cf2a1f >2013-12-04 06:17:51,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6019386f >2013-12-04 06:17:51,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cbd0642, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b677cfdd}, log id: 6019386f >2013-12-04 06:17:56,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5987d22d >2013-12-04 06:17:56,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5987d22d >2013-12-04 06:17:56,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7d288d26 >2013-12-04 06:17:57,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6b07e4b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8701fca3}, log id: 7d288d26 >2013-12-04 06:18:02,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1802ac64 >2013-12-04 06:18:02,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1802ac64 >2013-12-04 06:18:02,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 788a2e19 >2013-12-04 06:18:02,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@518778bd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6344f9c3}, log id: 788a2e19 >2013-12-04 06:18:08,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5198a63d >2013-12-04 06:18:08,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5198a63d >2013-12-04 06:18:08,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4ab4084 >2013-12-04 06:18:08,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8da3bbe0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e99e93a4}, log id: 4ab4084 >2013-12-04 06:18:13,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 50be4891 >2013-12-04 06:18:14,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 50be4891 >2013-12-04 06:18:14,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e25e7ce >2013-12-04 06:18:14,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9da7c864, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac2d36d0}, log id: 7e25e7ce >2013-12-04 06:18:19,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b12ded7 >2013-12-04 06:18:20,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b12ded7 >2013-12-04 06:18:20,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 146282bd >2013-12-04 06:18:20,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a7c2b85, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4ee31ad}, log id: 146282bd >2013-12-04 06:18:25,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7db4fa15 >2013-12-04 06:18:26,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7db4fa15 >2013-12-04 06:18:26,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 42bf184e >2013-12-04 06:18:26,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1727540b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e11f8893}, log id: 42bf184e >2013-12-04 06:18:31,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3c011232 >2013-12-04 06:18:31,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c011232 >2013-12-04 06:18:31,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2a48ff1b >2013-12-04 06:18:32,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10393bbb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d94ddf0}, log id: 2a48ff1b >2013-12-04 06:18:37,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d123af9 >2013-12-04 06:18:37,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d123af9 >2013-12-04 06:18:37,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b20f03a >2013-12-04 06:18:37,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16fb3661, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbd35a62}, log id: 5b20f03a >2013-12-04 06:18:42,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1c578c5 >2013-12-04 06:18:43,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c578c5 >2013-12-04 06:18:43,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 281f7640 >2013-12-04 06:18:43,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f76e25, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c366737}, log id: 281f7640 >2013-12-04 06:18:48,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 20357b1f >2013-12-04 06:18:49,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20357b1f >2013-12-04 06:18:49,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 41ede9d8 >2013-12-04 06:18:49,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6de96d6b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a2bcb8e}, log id: 41ede9d8 >2013-12-04 06:18:50,025 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) No up server in cluster >2013-12-04 06:18:50,025 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:18:50,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: aed9b26 >2013-12-04 06:18:50,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, return: [], log id: aed9b26 >2013-12-04 06:18:54,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e30645b >2013-12-04 06:18:55,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2e30645b >2013-12-04 06:18:55,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a88ee7d >2013-12-04 06:18:55,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f82f3cfe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aba1d2ea}, log id: 6a88ee7d >2013-12-04 06:19:00,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 703c16b3 >2013-12-04 06:19:00,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 703c16b3 >2013-12-04 06:19:00,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 42ff6b20 >2013-12-04 06:19:01,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edbb6f6f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffe20bf7}, log id: 42ff6b20 >2013-12-04 06:19:06,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 52509616 >2013-12-04 06:19:06,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 52509616 >2013-12-04 06:19:06,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5fd73c6b >2013-12-04 06:19:07,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec633500, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6498f3c}, log id: 5fd73c6b >2013-12-04 06:19:07,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ee545f4 >2013-12-04 06:19:08,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@76c31af, log id: ee545f4 >2013-12-04 06:19:08,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5031dbf7 >2013-12-04 06:19:08,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2ecaffcb, log id: 5031dbf7 >2013-12-04 06:19:12,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b60187e >2013-12-04 06:19:12,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3b60187e >2013-12-04 06:19:12,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 33c9cd21 >2013-12-04 06:19:12,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@987c0df6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f88081d}, log id: 33c9cd21 >2013-12-04 06:19:17,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ba99e8c >2013-12-04 06:19:18,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3ba99e8c >2013-12-04 06:19:18,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 11a96d95 >2013-12-04 06:19:18,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bbc3e3f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83691839}, log id: 11a96d95 >2013-12-04 06:19:23,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 502bb840 >2013-12-04 06:19:24,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 502bb840 >2013-12-04 06:19:24,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 358e9b8e >2013-12-04 06:19:24,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7368c755, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d26211c}, log id: 358e9b8e >2013-12-04 06:19:29,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 455dfed2 >2013-12-04 06:19:30,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 455dfed2 >2013-12-04 06:19:30,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1bb2d57c >2013-12-04 06:19:30,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a809ee1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d16c456b}, log id: 1bb2d57c >2013-12-04 06:19:35,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70723079 >2013-12-04 06:19:35,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 70723079 >2013-12-04 06:19:35,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 27ec8ad4 >2013-12-04 06:19:36,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bf7a71f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84d95219}, log id: 27ec8ad4 >2013-12-04 06:19:41,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 730db51a >2013-12-04 06:19:41,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 730db51a >2013-12-04 06:19:41,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7255e5c2 >2013-12-04 06:19:42,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a21e177, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4ccc15c}, log id: 7255e5c2 >2013-12-04 06:19:47,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 64985873 >2013-12-04 06:19:47,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64985873 >2013-12-04 06:19:47,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 101d3910 >2013-12-04 06:19:47,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@232bc308, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5741714a}, log id: 101d3910 >2013-12-04 06:19:50,335 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-04 06:19:50,335 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:19:50,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4886fbd8 >2013-12-04 06:19:50,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4886fbd8 >2013-12-04 06:19:52,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e4f10d7 >2013-12-04 06:19:53,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7e4f10d7 >2013-12-04 06:19:53,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2ca9a4e2 >2013-12-04 06:19:53,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60ee04b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14060935}, log id: 2ca9a4e2 >2013-12-04 06:19:58,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 326f7f42 >2013-12-04 06:19:59,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 326f7f42 >2013-12-04 06:19:59,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6268b8a6 >2013-12-04 06:19:59,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c2738ac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f5e8291}, log id: 6268b8a6 >2013-12-04 06:20:04,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 450aeb89 >2013-12-04 06:20:05,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 450aeb89 >2013-12-04 06:20:05,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 41eb2d4e >2013-12-04 06:20:05,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c066bb88, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d812fa50}, log id: 41eb2d4e >2013-12-04 06:20:10,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a8739e9 >2013-12-04 06:20:10,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a8739e9 >2013-12-04 06:20:10,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 52f51edd >2013-12-04 06:20:11,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b584ac2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a12e24c9}, log id: 52f51edd >2013-12-04 06:20:16,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 441cb9aa >2013-12-04 06:20:16,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 441cb9aa >2013-12-04 06:20:16,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 65b22e02 >2013-12-04 06:20:16,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd13773d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@312d09bc}, log id: 65b22e02 >2013-12-04 06:20:21,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58c865c2 >2013-12-04 06:20:22,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 58c865c2 >2013-12-04 06:20:22,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 760f7cd2 >2013-12-04 06:20:22,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87c661, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9bab2ea}, log id: 760f7cd2 >2013-12-04 06:20:27,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32dd8c62 >2013-12-04 06:20:28,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 32dd8c62 >2013-12-04 06:20:28,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5e5bf097 >2013-12-04 06:20:28,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a6e0c9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68de38ad}, log id: 5e5bf097 >2013-12-04 06:20:33,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7cb9e952 >2013-12-04 06:20:34,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7cb9e952 >2013-12-04 06:20:34,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8533eb7 >2013-12-04 06:20:34,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27a102cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3139d2e3}, log id: 8533eb7 >2013-12-04 06:20:39,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 610bd046 >2013-12-04 06:20:39,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 610bd046 >2013-12-04 06:20:39,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a1cc8e >2013-12-04 06:20:40,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@577592f2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51a7ac3a}, log id: 1a1cc8e >2013-12-04 06:20:45,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58d3586b >2013-12-04 06:20:45,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 58d3586b >2013-12-04 06:20:45,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1bcc38dd >2013-12-04 06:20:46,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92563b9c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c1d6a44}, log id: 1bcc38dd >2013-12-04 06:20:50,667 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) No up server in cluster >2013-12-04 06:20:50,668 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:20:50,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 44cb0b29 >2013-12-04 06:20:50,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, return: [], log id: 44cb0b29 >2013-12-04 06:20:51,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4c111582 >2013-12-04 06:20:51,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c111582 >2013-12-04 06:20:51,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7e3039da >2013-12-04 06:20:51,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d9ac089, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d890a91}, log id: 7e3039da >2013-12-04 06:20:56,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47961684 >2013-12-04 06:20:57,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 47961684 >2013-12-04 06:20:57,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a1ba637 >2013-12-04 06:20:57,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f36e0283, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@279d2723}, log id: 7a1ba637 >2013-12-04 06:21:02,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3f8bde3b >2013-12-04 06:21:03,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f8bde3b >2013-12-04 06:21:03,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 438dc6b5 >2013-12-04 06:21:03,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3793640e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@697370ef}, log id: 438dc6b5 >2013-12-04 06:21:08,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 315269de >2013-12-04 06:21:09,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 315269de >2013-12-04 06:21:09,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73cce5b3 >2013-12-04 06:21:09,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@575e740f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e49436a3}, log id: 73cce5b3 >2013-12-04 06:21:14,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21670cb8 >2013-12-04 06:21:14,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 21670cb8 >2013-12-04 06:21:14,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 274224a7 >2013-12-04 06:21:15,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35adb425, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b548e38e}, log id: 274224a7 >2013-12-04 06:21:20,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 258bc11d >2013-12-04 06:21:20,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 258bc11d >2013-12-04 06:21:20,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a08bae5 >2013-12-04 06:21:20,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69e684c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7575019}, log id: 3a08bae5 >2013-12-04 06:21:25,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 231ec7c >2013-12-04 06:21:26,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 231ec7c >2013-12-04 06:21:26,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4dfcfda5 >2013-12-04 06:21:26,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f8ba885, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38168991}, log id: 4dfcfda5 >2013-12-04 06:21:31,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7330f140 >2013-12-04 06:21:32,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7330f140 >2013-12-04 06:21:32,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a0d845d >2013-12-04 06:21:32,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4892ba2e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ac36a1c}, log id: 1a0d845d >2013-12-04 06:21:37,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68a8fffb >2013-12-04 06:21:38,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 68a8fffb >2013-12-04 06:21:38,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 545823e9 >2013-12-04 06:21:38,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@822a154e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb44640c}, log id: 545823e9 >2013-12-04 06:21:43,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67f8d09d >2013-12-04 06:21:43,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 67f8d09d >2013-12-04 06:21:43,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2f0b2d65 >2013-12-04 06:21:44,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5dfe68f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b755e9fe}, log id: 2f0b2d65 >2013-12-04 06:21:49,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a679b61 >2013-12-04 06:21:49,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a679b61 >2013-12-04 06:21:49,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 52e89c8b >2013-12-04 06:21:50,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@690711fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32c51eda}, log id: 52e89c8b >2013-12-04 06:21:50,988 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-04 06:21:50,988 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:21:51,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e2e34f8 >2013-12-04 06:21:51,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7e2e34f8 >2013-12-04 06:21:55,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77c55ada >2013-12-04 06:21:55,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 77c55ada >2013-12-04 06:21:55,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 386272ea >2013-12-04 06:21:55,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1ae0711, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5ad1dce}, log id: 386272ea >2013-12-04 06:22:00,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 44ca10b4 >2013-12-04 06:22:01,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 44ca10b4 >2013-12-04 06:22:01,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 412a9030 >2013-12-04 06:22:01,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c64b735, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9e11f3f}, log id: 412a9030 >2013-12-04 06:22:06,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 26d0cc9a >2013-12-04 06:22:07,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 26d0cc9a >2013-12-04 06:22:07,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 16df3f31 >2013-12-04 06:22:07,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ada1809, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f38698d7}, log id: 16df3f31 >2013-12-04 06:22:12,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5ceb009b >2013-12-04 06:22:13,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ceb009b >2013-12-04 06:22:13,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 51ea09ba >2013-12-04 06:22:13,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c659b04a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67e59789}, log id: 51ea09ba >2013-12-04 06:22:18,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5fea2403 >2013-12-04 06:22:18,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fea2403 >2013-12-04 06:22:18,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: a030394 >2013-12-04 06:22:19,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d221acd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5000c5a2}, log id: a030394 >2013-12-04 06:22:24,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1624ebde >2013-12-04 06:22:24,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1624ebde >2013-12-04 06:22:24,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3be2505f >2013-12-04 06:22:25,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de83bf09, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6e365ea}, log id: 3be2505f >2013-12-04 06:22:30,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 50d910b8 >2013-12-04 06:22:30,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 50d910b8 >2013-12-04 06:22:30,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 764f7b5d >2013-12-04 06:22:30,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3df9f12, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b09c2b96}, log id: 764f7b5d >2013-12-04 06:22:35,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 819ba24 >2013-12-04 06:22:36,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 819ba24 >2013-12-04 06:22:36,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ed18516 >2013-12-04 06:22:36,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6d3201b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe3c0985}, log id: 1ed18516 >2013-12-04 06:22:41,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2bd1d7c3 >2013-12-04 06:22:42,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bd1d7c3 >2013-12-04 06:22:42,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 793a5e >2013-12-04 06:22:42,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17319b3a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@353b3170}, log id: 793a5e >2013-12-04 06:22:47,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6479c15e >2013-12-04 06:22:48,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6479c15e >2013-12-04 06:22:48,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 76d30688 >2013-12-04 06:22:48,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8b6df79, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cbe699d}, log id: 76d30688 >2013-12-04 06:22:51,309 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-04 06:22:51,309 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:22:51,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 255ccaa2 >2013-12-04 06:22:51,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 255ccaa2 >2013-12-04 06:22:53,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1835f75f >2013-12-04 06:22:53,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1835f75f >2013-12-04 06:22:53,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ad37885 >2013-12-04 06:22:54,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f10ebb4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6743c51}, log id: 3ad37885 >2013-12-04 06:22:59,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f43e01b >2013-12-04 06:22:59,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f43e01b >2013-12-04 06:22:59,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 637fa8af >2013-12-04 06:22:59,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb38db84, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77b658eb}, log id: 637fa8af >2013-12-04 06:23:04,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 33f7e523 >2013-12-04 06:23:05,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 33f7e523 >2013-12-04 06:23:05,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19d76b31 >2013-12-04 06:23:05,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd741f8f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf55a466}, log id: 19d76b31 >2013-12-04 06:23:10,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 186fc167 >2013-12-04 06:23:11,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 186fc167 >2013-12-04 06:23:11,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1cd8db24 >2013-12-04 06:23:11,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18723fb6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afcf83e8}, log id: 1cd8db24 >2013-12-04 06:23:16,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: ce4fd9f >2013-12-04 06:23:17,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: ce4fd9f >2013-12-04 06:23:17,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e843472 >2013-12-04 06:23:17,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a931cd7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1dc3d273}, log id: 2e843472 >2013-12-04 06:23:22,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 66f1e870 >2013-12-04 06:23:22,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 66f1e870 >2013-12-04 06:23:22,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 60a5bd00 >2013-12-04 06:23:23,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d53090f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb0b8713}, log id: 60a5bd00 >2013-12-04 06:23:28,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29bd0bef >2013-12-04 06:23:28,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 29bd0bef >2013-12-04 06:23:28,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3bece426 >2013-12-04 06:23:28,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@267301f5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edbef66c}, log id: 3bece426 >2013-12-04 06:23:34,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 790865dd >2013-12-04 06:23:34,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 790865dd >2013-12-04 06:23:34,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40f284b4 >2013-12-04 06:23:34,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@579bcad9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54da51f6}, log id: 40f284b4 >2013-12-04 06:23:39,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b2a1b7a >2013-12-04 06:23:40,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b2a1b7a >2013-12-04 06:23:40,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53d1877 >2013-12-04 06:23:40,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6953339, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ace23d}, log id: 53d1877 >2013-12-04 06:23:45,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: abe4114 >2013-12-04 06:23:46,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: abe4114 >2013-12-04 06:23:46,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78eb21a3 >2013-12-04 06:23:46,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b439a9f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99fbb794}, log id: 78eb21a3 >2013-12-04 06:23:51,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6f0984de >2013-12-04 06:23:51,619 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) No up server in cluster >2013-12-04 06:23:51,619 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:23:51,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 348ff0e9 >2013-12-04 06:23:51,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, return: [], log id: 348ff0e9 >2013-12-04 06:23:51,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f0984de >2013-12-04 06:23:51,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 37aeea4e >2013-12-04 06:23:52,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fe8aed6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e3d4233}, log id: 37aeea4e >2013-12-04 06:23:57,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78d6064d >2013-12-04 06:23:57,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 78d6064d >2013-12-04 06:23:57,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 44c27643 >2013-12-04 06:23:58,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b496d162, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@597f3bb1}, log id: 44c27643 >2013-12-04 06:24:03,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5b283ab4 >2013-12-04 06:24:03,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b283ab4 >2013-12-04 06:24:03,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2f7509d4 >2013-12-04 06:24:03,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0d1895b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ac6135c}, log id: 2f7509d4 >2013-12-04 06:24:08,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e5f8b43 >2013-12-04 06:24:08,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1f4f97c5, log id: 6e5f8b43 >2013-12-04 06:24:08,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 22751692 >2013-12-04 06:24:08,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3e8fede0, log id: 22751692 >2013-12-04 06:24:08,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 389bd2b >2013-12-04 06:24:09,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 389bd2b >2013-12-04 06:24:09,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 11a775a7 >2013-12-04 06:24:09,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4f03132, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9358e045}, log id: 11a775a7 >2013-12-04 06:24:14,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1122cbf2 >2013-12-04 06:24:15,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1122cbf2 >2013-12-04 06:24:15,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fb10c5 >2013-12-04 06:24:15,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc534767, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8016e577}, log id: 2fb10c5 >2013-12-04 06:24:20,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43227f16 >2013-12-04 06:24:21,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 43227f16 >2013-12-04 06:24:21,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d6405d6 >2013-12-04 06:24:21,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e5e41d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc38cd62}, log id: 5d6405d6 >2013-12-04 06:24:26,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a739fa2 >2013-12-04 06:24:26,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a739fa2 >2013-12-04 06:24:26,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 485d5938 >2013-12-04 06:24:27,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c21df0d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@872cbf6e}, log id: 485d5938 >2013-12-04 06:24:32,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 961c681 >2013-12-04 06:24:32,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 961c681 >2013-12-04 06:24:32,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78bda4b8 >2013-12-04 06:24:33,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a8e247d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4a44114}, log id: 78bda4b8 >2013-12-04 06:24:38,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 382c3da >2013-12-04 06:24:38,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 382c3da >2013-12-04 06:24:38,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42998de8 >2013-12-04 06:24:38,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68571cdc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53708283}, log id: 42998de8 >2013-12-04 06:24:43,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78a99ea9 >2013-12-04 06:24:44,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 78a99ea9 >2013-12-04 06:24:44,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 438c521c >2013-12-04 06:24:44,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9eb80cf5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b639f515}, log id: 438c521c >2013-12-04 06:24:49,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1bec2b36 >2013-12-04 06:24:50,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bec2b36 >2013-12-04 06:24:50,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7e1938d4 >2013-12-04 06:24:50,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d438aaa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@333958e7}, log id: 7e1938d4 >2013-12-04 06:24:51,916 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-04 06:24:51,917 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:24:51,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22db8e9e >2013-12-04 06:24:52,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 22db8e9e >2013-12-04 06:24:55,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8f522c8 >2013-12-04 06:24:56,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 8f522c8 >2013-12-04 06:24:56,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c49422e >2013-12-04 06:24:56,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc1740b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94d40b3c}, log id: 1c49422e >2013-12-04 06:25:01,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f1ba69e >2013-12-04 06:25:01,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6f1ba69e >2013-12-04 06:25:01,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63571683 >2013-12-04 06:25:02,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c448572, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55cb4265}, log id: 63571683 >2013-12-04 06:25:07,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18ec3512 >2013-12-04 06:25:07,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 18ec3512 >2013-12-04 06:25:07,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7813d919 >2013-12-04 06:25:08,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2f44c7d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbfeb58a}, log id: 7813d919 >2013-12-04 06:25:13,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4b11968d >2013-12-04 06:25:13,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b11968d >2013-12-04 06:25:13,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7b303a06 >2013-12-04 06:25:13,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6d6e971, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca0c15ce}, log id: 7b303a06 >2013-12-04 06:25:18,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 12458959 >2013-12-04 06:25:19,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12458959 >2013-12-04 06:25:19,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: c0d04bb >2013-12-04 06:25:19,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@713cc428, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51f18824}, log id: c0d04bb >2013-12-04 06:25:24,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6bdcb133 >2013-12-04 06:25:25,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bdcb133 >2013-12-04 06:25:25,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f4586a4 >2013-12-04 06:25:25,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4de45bb4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87d275f6}, log id: 7f4586a4 >2013-12-04 06:25:30,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 215d408e >2013-12-04 06:25:31,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 215d408e >2013-12-04 06:25:31,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 763d4a8a >2013-12-04 06:25:31,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@980c4bbd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e023c48d}, log id: 763d4a8a >2013-12-04 06:25:36,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5de853b9 >2013-12-04 06:25:36,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5de853b9 >2013-12-04 06:25:36,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36325d32 >2013-12-04 06:25:37,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c61f3d0e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f76def2}, log id: 36325d32 >2013-12-04 06:25:42,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3bfc633d >2013-12-04 06:25:42,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3bfc633d >2013-12-04 06:25:42,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6e4fed96 >2013-12-04 06:25:43,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b05ac182, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4a3d1bc}, log id: 6e4fed96 >2013-12-04 06:25:48,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7644b29 >2013-12-04 06:25:48,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7644b29 >2013-12-04 06:25:48,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4db891dd >2013-12-04 06:25:48,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6484d7e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3313bcab}, log id: 4db891dd >2013-12-04 06:25:52,218 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-04 06:25:52,218 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:25:52,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 238fffc6 >2013-12-04 06:25:52,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: 238fffc6 >2013-12-04 06:25:53,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6dcfe2f4 >2013-12-04 06:25:54,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6dcfe2f4 >2013-12-04 06:25:54,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 300104dd >2013-12-04 06:25:54,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4997a83a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12d03092}, log id: 300104dd >2013-12-04 06:25:59,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3f23292c >2013-12-04 06:26:00,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f23292c >2013-12-04 06:26:00,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1693642f >2013-12-04 06:26:00,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddc51719, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2712ee9}, log id: 1693642f >2013-12-04 06:26:05,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 51b4ffce >2013-12-04 06:26:06,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 51b4ffce >2013-12-04 06:26:06,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 460fd12f >2013-12-04 06:26:06,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de8699c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c89e0f65}, log id: 460fd12f >2013-12-04 06:26:11,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a63cf07 >2013-12-04 06:26:11,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a63cf07 >2013-12-04 06:26:11,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b1e50c8 >2013-12-04 06:26:12,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e083a4fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79554276}, log id: 1b1e50c8 >2013-12-04 06:26:17,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4678d8e8 >2013-12-04 06:26:17,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4678d8e8 >2013-12-04 06:26:17,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b33f5a >2013-12-04 06:26:17,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1c8c880, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad38f9db}, log id: 6b33f5a >2013-12-04 06:26:23,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19788fee >2013-12-04 06:26:23,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 19788fee >2013-12-04 06:26:23,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6699b931 >2013-12-04 06:26:23,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e0e4912, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@882283fd}, log id: 6699b931 >2013-12-04 06:26:28,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d8fb084 >2013-12-04 06:26:29,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4d8fb084 >2013-12-04 06:26:29,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2feba3d1 >2013-12-04 06:26:29,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb99fd76, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@957d02e2}, log id: 2feba3d1 >2013-12-04 06:26:34,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f2f866b >2013-12-04 06:26:35,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3f2f866b >2013-12-04 06:26:35,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 242dc943 >2013-12-04 06:26:35,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cec6bc28, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa673b53}, log id: 242dc943 >2013-12-04 06:26:40,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 394d7a4d >2013-12-04 06:26:41,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 394d7a4d >2013-12-04 06:26:41,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 519bde7c >2013-12-04 06:26:41,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdf1c998, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0a95f97}, log id: 519bde7c >2013-12-04 06:26:46,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 16df5807 >2013-12-04 06:26:46,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 16df5807 >2013-12-04 06:26:46,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 715c4718 >2013-12-04 06:26:47,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2bda0eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baacf7b}, log id: 715c4718 >2013-12-04 06:26:52,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63628851 >2013-12-04 06:26:52,513 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) No up server in cluster >2013-12-04 06:26:52,513 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:26:52,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 51353ca1 >2013-12-04 06:26:52,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 63628851 >2013-12-04 06:26:52,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 43b0fa70 >2013-12-04 06:26:52,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, return: [], log id: 51353ca1 >2013-12-04 06:26:52,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc6c7f91, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17b4a9c3}, log id: 43b0fa70 >2013-12-04 06:26:58,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 64a0a96a >2013-12-04 06:26:58,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 64a0a96a >2013-12-04 06:26:58,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 8437662 >2013-12-04 06:26:58,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1eb31f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6c37002}, log id: 8437662 >2013-12-04 06:27:03,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6cd4404 >2013-12-04 06:27:04,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6cd4404 >2013-12-04 06:27:04,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2fd5ccc7 >2013-12-04 06:27:04,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb26ac85, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@651e9e4e}, log id: 2fd5ccc7 >2013-12-04 06:27:09,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2be75223 >2013-12-04 06:27:10,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2be75223 >2013-12-04 06:27:10,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1f416f8a >2013-12-04 06:27:10,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc993ad7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e8324a2}, log id: 1f416f8a >2013-12-04 06:27:15,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59e524f1 >2013-12-04 06:27:15,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 59e524f1 >2013-12-04 06:27:15,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 62691817 >2013-12-04 06:27:16,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b506568, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a8572c0}, log id: 62691817 >2013-12-04 06:27:21,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 258e7ca5 >2013-12-04 06:27:21,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 258e7ca5 >2013-12-04 06:27:21,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 714ab19a >2013-12-04 06:27:21,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@270d4967, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4032f38}, log id: 714ab19a >2013-12-04 06:27:27,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2873ac8a >2013-12-04 06:27:27,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2873ac8a >2013-12-04 06:27:27,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 49682990 >2013-12-04 06:27:27,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c7efe2a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@848b6be5}, log id: 49682990 >2013-12-04 06:27:32,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d178bf4 >2013-12-04 06:27:33,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d178bf4 >2013-12-04 06:27:33,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 354c231f >2013-12-04 06:27:33,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39fde869, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c45d592e}, log id: 354c231f >2013-12-04 06:27:38,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 65928f4b >2013-12-04 06:27:39,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 65928f4b >2013-12-04 06:27:39,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: b37d74a >2013-12-04 06:27:39,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72e28c10, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44c3d850}, log id: b37d74a >2013-12-04 06:27:44,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2da6f879 >2013-12-04 06:27:44,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2da6f879 >2013-12-04 06:27:44,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d6360d4 >2013-12-04 06:27:45,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@983de2ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d53b22e}, log id: d6360d4 >2013-12-04 06:27:50,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 676fb07a >2013-12-04 06:27:50,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 676fb07a >2013-12-04 06:27:50,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: f0f67ac >2013-12-04 06:27:51,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@958642b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c5d1cb4}, log id: f0f67ac >2013-12-04 06:27:52,800 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-04 06:27:52,800 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:27:52,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 19d73179 >2013-12-04 06:27:53,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 19d73179 >2013-12-04 06:27:56,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: e967698 >2013-12-04 06:27:56,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: e967698 >2013-12-04 06:27:56,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 624fb73b >2013-12-04 06:27:56,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff2d780c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51295f0c}, log id: 624fb73b >2013-12-04 06:28:01,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e875d0d >2013-12-04 06:28:02,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e875d0d >2013-12-04 06:28:02,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6868fe3c >2013-12-04 06:28:02,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51caa3b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8fee761}, log id: 6868fe3c >2013-12-04 06:28:07,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c3141b5 >2013-12-04 06:28:08,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c3141b5 >2013-12-04 06:28:08,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68e1f854 >2013-12-04 06:28:08,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@345d8000, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1df31c01}, log id: 68e1f854 >2013-12-04 06:28:13,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 583a9575 >2013-12-04 06:28:14,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 583a9575 >2013-12-04 06:28:14,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ba338cf >2013-12-04 06:28:14,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0c34b31, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@665cd59f}, log id: 5ba338cf >2013-12-04 06:28:19,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67e4528 >2013-12-04 06:28:19,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 67e4528 >2013-12-04 06:28:19,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b59c047 >2013-12-04 06:28:20,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f067dec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92ee990a}, log id: 2b59c047 >2013-12-04 06:28:25,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6c717521 >2013-12-04 06:28:25,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c717521 >2013-12-04 06:28:25,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d84a787 >2013-12-04 06:28:26,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a52f814, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@340635cc}, log id: 2d84a787 >2013-12-04 06:28:31,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6df43634 >2013-12-04 06:28:31,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6df43634 >2013-12-04 06:28:31,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6dee1a57 >2013-12-04 06:28:31,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c643f769, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5d560b9}, log id: 6dee1a57 >2013-12-04 06:28:36,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4716107 >2013-12-04 06:28:37,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4716107 >2013-12-04 06:28:37,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4c1b0bfc >2013-12-04 06:28:37,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3305d247, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68389e5b}, log id: 4c1b0bfc >2013-12-04 06:28:42,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 52aa148e >2013-12-04 06:28:43,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52aa148e >2013-12-04 06:28:43,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 75dd6e87 >2013-12-04 06:28:43,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ed40b73, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@faf9d2bd}, log id: 75dd6e87 >2013-12-04 06:28:48,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 797f7737 >2013-12-04 06:28:49,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 797f7737 >2013-12-04 06:28:49,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46bc9138 >2013-12-04 06:28:49,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9f01d56, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c231a92}, log id: 46bc9138 >2013-12-04 06:28:53,139 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-04 06:28:53,140 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:28:53,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 620f9b4e >2013-12-04 06:28:53,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 620f9b4e >2013-12-04 06:28:54,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 492fdbb3 >2013-12-04 06:28:54,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 492fdbb3 >2013-12-04 06:28:54,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7abe7235 >2013-12-04 06:28:55,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d0a9e88, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9f7a067}, log id: 7abe7235 >2013-12-04 06:29:00,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 316d1a0f >2013-12-04 06:29:00,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 316d1a0f >2013-12-04 06:29:00,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2214da5f >2013-12-04 06:29:01,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c507064, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41c0906e}, log id: 2214da5f >2013-12-04 06:29:06,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29a15722 >2013-12-04 06:29:06,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 29a15722 >2013-12-04 06:29:06,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c53fb71 >2013-12-04 06:29:06,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@818f06b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b0168f7}, log id: 5c53fb71 >2013-12-04 06:29:08,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 77af928d >2013-12-04 06:29:09,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2bc05edf, log id: 77af928d >2013-12-04 06:29:09,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 629498e9 >2013-12-04 06:29:09,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@14807f51, log id: 629498e9 >2013-12-04 06:29:11,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3ec77f70 >2013-12-04 06:29:12,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ec77f70 >2013-12-04 06:29:12,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6644bdc4 >2013-12-04 06:29:12,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f36c7fe5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b78a9f9}, log id: 6644bdc4 >2013-12-04 06:29:17,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5b3efc32 >2013-12-04 06:29:18,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b3efc32 >2013-12-04 06:29:18,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5b54289b >2013-12-04 06:29:18,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@128a6f49, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eeb0da2d}, log id: 5b54289b >2013-12-04 06:29:23,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2f06807a >2013-12-04 06:29:24,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f06807a >2013-12-04 06:29:24,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: c81b8c0 >2013-12-04 06:29:24,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@494e55f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d231ddc8}, log id: c81b8c0 >2013-12-04 06:29:29,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 77b8e5b7 >2013-12-04 06:29:29,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 77b8e5b7 >2013-12-04 06:29:29,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e3f0dfc >2013-12-04 06:29:30,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@840d82d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f513786}, log id: 2e3f0dfc >2013-12-04 06:29:35,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ece6a47 >2013-12-04 06:29:35,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ece6a47 >2013-12-04 06:29:35,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5534382a >2013-12-04 06:29:35,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0e97081, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0399335}, log id: 5534382a >2013-12-04 06:29:40,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30c2dd69 >2013-12-04 06:29:41,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 30c2dd69 >2013-12-04 06:29:41,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69b02367 >2013-12-04 06:29:41,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c9c5e13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98a0ee5b}, log id: 69b02367 >2013-12-04 06:29:46,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: a0624f3 >2013-12-04 06:29:47,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: a0624f3 >2013-12-04 06:29:47,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2202f19a >2013-12-04 06:29:47,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73d12164, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32311b9c}, log id: 2202f19a >2013-12-04 06:29:52,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11221d82 >2013-12-04 06:29:53,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 11221d82 >2013-12-04 06:29:53,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 44de5255 >2013-12-04 06:29:53,452 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) No up server in cluster >2013-12-04 06:29:53,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc46ed6c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b7b55de}, log id: 44de5255 >2013-12-04 06:29:53,453 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:29:53,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 114fb9d6 >2013-12-04 06:29:53,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterTasksListVDSCommand, return: [], log id: 114fb9d6 >2013-12-04 06:29:58,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 107a0645 >2013-12-04 06:29:59,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 107a0645 >2013-12-04 06:29:59,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45b0173f >2013-12-04 06:29:59,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6c477d1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@511559de}, log id: 45b0173f >2013-12-04 06:30:04,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 27dfcaf8 >2013-12-04 06:30:04,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27dfcaf8 >2013-12-04 06:30:04,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 34a0ed39 >2013-12-04 06:30:05,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@668ff5e4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d75f31e4}, log id: 34a0ed39 >2013-12-04 06:30:10,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 660b9f15 >2013-12-04 06:30:10,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 660b9f15 >2013-12-04 06:30:10,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 74aaf1d2 >2013-12-04 06:30:10,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15350d3d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd4aa5e8}, log id: 74aaf1d2 >2013-12-04 06:30:15,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4810355b >2013-12-04 06:30:16,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4810355b >2013-12-04 06:30:16,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 371b75b4 >2013-12-04 06:30:16,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@caea641f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78f43531}, log id: 371b75b4 >2013-12-04 06:30:21,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c573cc4 >2013-12-04 06:30:22,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4c573cc4 >2013-12-04 06:30:22,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d01c564 >2013-12-04 06:30:22,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f81fc32a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0c822e9}, log id: 3d01c564 >2013-12-04 06:30:27,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 87751ec >2013-12-04 06:30:28,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 87751ec >2013-12-04 06:30:28,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5233a067 >2013-12-04 06:30:28,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca090405, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cc95bb1}, log id: 5233a067 >2013-12-04 06:30:33,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7d7db3bc >2013-12-04 06:30:33,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d7db3bc >2013-12-04 06:30:33,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: c0e5c56 >2013-12-04 06:30:34,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e3251e2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78d5cca5}, log id: c0e5c56 >2013-12-04 06:30:39,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39a5c0d5 >2013-12-04 06:30:39,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 39a5c0d5 >2013-12-04 06:30:39,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5e0c3128 >2013-12-04 06:30:40,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf517e1d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2dfd2d4c}, log id: 5e0c3128 >2013-12-04 06:30:45,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 45c31b4f >2013-12-04 06:30:45,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45c31b4f >2013-12-04 06:30:45,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4d6b3f35 >2013-12-04 06:30:45,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc6426c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc49a8ef}, log id: 4d6b3f35 >2013-12-04 06:30:50,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f61e2b5 >2013-12-04 06:30:51,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f61e2b5 >2013-12-04 06:30:51,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1fcbc60b >2013-12-04 06:30:51,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6971d429, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d5edbc6}, log id: 1fcbc60b >2013-12-04 06:30:53,766 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-04 06:30:53,767 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:30:53,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78380116 >2013-12-04 06:30:54,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: 78380116 >2013-12-04 06:30:56,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6dcfaadb >2013-12-04 06:30:57,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6dcfaadb >2013-12-04 06:30:57,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 64ad8ed3 >2013-12-04 06:30:57,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2d530f6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3f877fc}, log id: 64ad8ed3 >2013-12-04 06:31:02,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7eb1016c >2013-12-04 06:31:03,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7eb1016c >2013-12-04 06:31:03,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 659d6bc6 >2013-12-04 06:31:03,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63c8c37d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e85a273}, log id: 659d6bc6 >2013-12-04 06:31:08,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7cf68170 >2013-12-04 06:31:08,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7cf68170 >2013-12-04 06:31:08,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e55f98b >2013-12-04 06:31:09,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2208dea9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ced1a9b1}, log id: 6e55f98b >2013-12-04 06:31:14,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70ace4b >2013-12-04 06:31:14,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 70ace4b >2013-12-04 06:31:14,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c7c8815 >2013-12-04 06:31:14,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@536ad32d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@286c6ef9}, log id: 5c7c8815 >2013-12-04 06:31:20,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 49f2f6b9 >2013-12-04 06:31:20,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 49f2f6b9 >2013-12-04 06:31:20,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2cea02a7 >2013-12-04 06:31:20,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a204989, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c88ebab}, log id: 2cea02a7 >2013-12-04 06:31:25,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5bb4b8c0 >2013-12-04 06:31:26,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5bb4b8c0 >2013-12-04 06:31:26,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e571fc1 >2013-12-04 06:31:26,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a22bc95, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6599578f}, log id: 4e571fc1 >2013-12-04 06:31:31,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 15f23043 >2013-12-04 06:31:32,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 15f23043 >2013-12-04 06:31:32,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 15b00885 >2013-12-04 06:31:32,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d86c505, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aad92931}, log id: 15b00885 >2013-12-04 06:31:37,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 60af4c1c >2013-12-04 06:31:38,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60af4c1c >2013-12-04 06:31:38,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 17935c10 >2013-12-04 06:31:38,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b993a2d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fb9d7dc}, log id: 17935c10 >2013-12-04 06:31:43,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3bd97469 >2013-12-04 06:31:43,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3bd97469 >2013-12-04 06:31:43,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 790dd66a >2013-12-04 06:31:44,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59dcad0a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e52212b}, log id: 790dd66a >2013-12-04 06:31:49,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30fed039 >2013-12-04 06:31:49,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 30fed039 >2013-12-04 06:31:49,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3ef56de0 >2013-12-04 06:31:49,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfd30d01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afe352b8}, log id: 3ef56de0 >2013-12-04 06:31:54,084 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) No up server in cluster >2013-12-04 06:31:54,085 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:31:54,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f38081a >2013-12-04 06:31:54,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7f38081a >2013-12-04 06:31:54,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c9477ea >2013-12-04 06:31:55,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3c9477ea >2013-12-04 06:31:55,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c25fc6 >2013-12-04 06:31:55,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d3f7f07, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9d79539}, log id: 6c25fc6 >2013-12-04 06:32:00,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 82fc6b >2013-12-04 06:32:01,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 82fc6b >2013-12-04 06:32:01,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e4869df >2013-12-04 06:32:01,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ca414af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d498fbb}, log id: 7e4869df >2013-12-04 06:32:06,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70316c92 >2013-12-04 06:32:07,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 70316c92 >2013-12-04 06:32:07,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f39a0d6 >2013-12-04 06:32:07,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9658f34, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72158ef2}, log id: 3f39a0d6 >2013-12-04 06:32:12,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: c3c71bf >2013-12-04 06:32:12,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: c3c71bf >2013-12-04 06:32:12,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 171015b5 >2013-12-04 06:32:13,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ebc093, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32b1f4c2}, log id: 171015b5 >2013-12-04 06:32:18,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d2b0a3d >2013-12-04 06:32:18,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d2b0a3d >2013-12-04 06:32:18,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 457b0e92 >2013-12-04 06:32:19,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@610e03f6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8458d742}, log id: 457b0e92 >2013-12-04 06:32:24,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1066cb0 >2013-12-04 06:32:24,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1066cb0 >2013-12-04 06:32:24,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 75f71416 >2013-12-04 06:32:24,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c88537b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc49e4be}, log id: 75f71416 >2013-12-04 06:32:29,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 245458fa >2013-12-04 06:32:30,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 245458fa >2013-12-04 06:32:30,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 220e0c15 >2013-12-04 06:32:30,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@872e4f17, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c40b674}, log id: 220e0c15 >2013-12-04 06:32:35,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b81fd85 >2013-12-04 06:32:36,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b81fd85 >2013-12-04 06:32:36,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 22e86df3 >2013-12-04 06:32:36,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78b80d19, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b29f5572}, log id: 22e86df3 >2013-12-04 06:32:41,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 330a1f87 >2013-12-04 06:32:42,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 330a1f87 >2013-12-04 06:32:42,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e66aab >2013-12-04 06:32:42,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ec97437, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@234c068d}, log id: 7e66aab >2013-12-04 06:32:47,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 340adfd1 >2013-12-04 06:32:47,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 340adfd1 >2013-12-04 06:32:47,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 687a2c6f >2013-12-04 06:32:48,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@391bf126, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48618cd}, log id: 687a2c6f >2013-12-04 06:32:53,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 84b1818 >2013-12-04 06:32:53,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 84b1818 >2013-12-04 06:32:53,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4a6d6bf6 >2013-12-04 06:32:53,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee407988, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@476a369a}, log id: 4a6d6bf6 >2013-12-04 06:32:54,393 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) No up server in cluster >2013-12-04 06:32:54,393 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:32:54,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17d7866d >2013-12-04 06:32:54,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, return: [], log id: 17d7866d >2013-12-04 06:32:59,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7c5570b >2013-12-04 06:32:59,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7c5570b >2013-12-04 06:32:59,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 205d284 >2013-12-04 06:32:59,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8ea366a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80cece14}, log id: 205d284 >2013-12-04 06:33:04,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6bbaeb2e >2013-12-04 06:33:05,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bbaeb2e >2013-12-04 06:33:05,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 697e9f0d >2013-12-04 06:33:05,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9aa45e63, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4750860}, log id: 697e9f0d >2013-12-04 06:33:10,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 340cbdb4 >2013-12-04 06:33:11,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 340cbdb4 >2013-12-04 06:33:11,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 55710374 >2013-12-04 06:33:11,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad9487c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd986efa}, log id: 55710374 >2013-12-04 06:33:16,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7b787ab7 >2013-12-04 06:33:16,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b787ab7 >2013-12-04 06:33:16,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36dbc85f >2013-12-04 06:33:17,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54ba9299, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46392b8d}, log id: 36dbc85f >2013-12-04 06:33:22,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32cc3bce >2013-12-04 06:33:22,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 32cc3bce >2013-12-04 06:33:22,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ba9901 >2013-12-04 06:33:23,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc63a9ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2078733b}, log id: 7ba9901 >2013-12-04 06:33:28,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 93e7bcb >2013-12-04 06:33:28,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 93e7bcb >2013-12-04 06:33:28,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b5995d1 >2013-12-04 06:33:28,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d7a5494, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85e1f6e5}, log id: 5b5995d1 >2013-12-04 06:33:33,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69588e83 >2013-12-04 06:33:34,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 69588e83 >2013-12-04 06:33:34,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b1be6e7 >2013-12-04 06:33:34,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e0c37b0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da1e257b}, log id: 1b1be6e7 >2013-12-04 06:33:39,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1067bddc >2013-12-04 06:33:40,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1067bddc >2013-12-04 06:33:40,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38fab231 >2013-12-04 06:33:40,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2e4d72d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf38fed3}, log id: 38fab231 >2013-12-04 06:33:45,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5b687034 >2013-12-04 06:33:46,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b687034 >2013-12-04 06:33:46,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 279c8d46 >2013-12-04 06:33:46,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4895f1a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f922e7e}, log id: 279c8d46 >2013-12-04 06:33:51,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 403a1681 >2013-12-04 06:33:52,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 403a1681 >2013-12-04 06:33:52,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 341d1ee9 >2013-12-04 06:33:52,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@986fbd97, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6543603d}, log id: 341d1ee9 >2013-12-04 06:33:54,708 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-04 06:33:54,708 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:33:54,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 11719dd3 >2013-12-04 06:33:55,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 11719dd3 >2013-12-04 06:33:57,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 25d70d98 >2013-12-04 06:33:57,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25d70d98 >2013-12-04 06:33:57,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 73e1ec05 >2013-12-04 06:33:58,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@148a0e15, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3487d9a7}, log id: 73e1ec05 >2013-12-04 06:34:03,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c6daf9e >2013-12-04 06:34:03,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c6daf9e >2013-12-04 06:34:03,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43f91808 >2013-12-04 06:34:04,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fa9dd7d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffe695a3}, log id: 43f91808 >2013-12-04 06:34:09,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 155b4292 >2013-12-04 06:34:09,544 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-57) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 06:34:09,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 155b4292 >2013-12-04 06:34:09,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: c2403df >2013-12-04 06:34:09,575 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-57) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 06:34:09,678 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-57) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 06:34:09,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bde12b41, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b014eef9}, log id: c2403df >2013-12-04 06:34:09,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1b93b864 >2013-12-04 06:34:10,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@59bbed6e, log id: 1b93b864 >2013-12-04 06:34:10,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40e0fec8 >2013-12-04 06:34:10,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2644895, log id: 40e0fec8 >2013-12-04 06:34:14,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 55551eb2 >2013-12-04 06:34:15,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 55551eb2 >2013-12-04 06:34:15,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: aeddbf >2013-12-04 06:34:15,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa7bc91a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b21f823}, log id: aeddbf >2013-12-04 06:34:20,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 129d8450 >2013-12-04 06:34:21,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 129d8450 >2013-12-04 06:34:21,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 447517e9 >2013-12-04 06:34:21,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe8333ce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@837d248}, log id: 447517e9 >2013-12-04 06:34:26,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f347ea0 >2013-12-04 06:34:27,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f347ea0 >2013-12-04 06:34:27,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3984125b >2013-12-04 06:34:27,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45248baf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85e63ebf}, log id: 3984125b >2013-12-04 06:34:32,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a84ff87 >2013-12-04 06:34:32,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a84ff87 >2013-12-04 06:34:32,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b7680f9 >2013-12-04 06:34:33,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6ba5182, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2514042}, log id: 6b7680f9 >2013-12-04 06:34:38,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1d5fd4ef >2013-12-04 06:34:38,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d5fd4ef >2013-12-04 06:34:38,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 615446ab >2013-12-04 06:34:39,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c1fe308, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1aac5255}, log id: 615446ab >2013-12-04 06:34:44,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b79088f >2013-12-04 06:34:44,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b79088f >2013-12-04 06:34:44,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f80f6d7 >2013-12-04 06:34:44,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2da83d97, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87bae4ee}, log id: 1f80f6d7 >2013-12-04 06:34:49,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 75f4b0be >2013-12-04 06:34:50,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 75f4b0be >2013-12-04 06:34:50,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 25b0ac8d >2013-12-04 06:34:50,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da4244a2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc9f8c93}, log id: 25b0ac8d >2013-12-04 06:34:55,021 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-04 06:34:55,021 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:34:55,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 61164e95 >2013-12-04 06:34:55,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 61164e95 >2013-12-04 06:34:55,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f263643 >2013-12-04 06:34:56,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6f263643 >2013-12-04 06:34:56,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2377a681 >2013-12-04 06:34:56,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcd21175, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50839c4}, log id: 2377a681 >2013-12-04 06:35:01,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 62e6af45 >2013-12-04 06:35:02,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 62e6af45 >2013-12-04 06:35:02,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41a8bad1 >2013-12-04 06:35:02,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5b24c95, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40e91eaf}, log id: 41a8bad1 >2013-12-04 06:35:07,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6cd361bc >2013-12-04 06:35:07,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6cd361bc >2013-12-04 06:35:07,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63d0081 >2013-12-04 06:35:08,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cc7407c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b002aed}, log id: 63d0081 >2013-12-04 06:35:13,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36927172 >2013-12-04 06:35:13,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36927172 >2013-12-04 06:35:13,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7ec77086 >2013-12-04 06:35:13,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e254839, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45a537e3}, log id: 7ec77086 >2013-12-04 06:35:19,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3bcaf01e >2013-12-04 06:35:19,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bcaf01e >2013-12-04 06:35:19,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53364796 >2013-12-04 06:35:19,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ef8bba9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@accc764e}, log id: 53364796 >2013-12-04 06:35:24,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b30b1a1 >2013-12-04 06:35:25,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b30b1a1 >2013-12-04 06:35:25,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 44d17ff1 >2013-12-04 06:35:25,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a41553d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2f6ec48}, log id: 44d17ff1 >2013-12-04 06:35:30,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 66f0f14d >2013-12-04 06:35:31,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66f0f14d >2013-12-04 06:35:31,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 530e61f1 >2013-12-04 06:35:31,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9b63cd4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cdc4d93}, log id: 530e61f1 >2013-12-04 06:35:36,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 56a96bf3 >2013-12-04 06:35:37,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 56a96bf3 >2013-12-04 06:35:37,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42d10173 >2013-12-04 06:35:37,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5da711e2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57a306b8}, log id: 42d10173 >2013-12-04 06:35:42,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b2bf785 >2013-12-04 06:35:42,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b2bf785 >2013-12-04 06:35:42,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2cce73f3 >2013-12-04 06:35:43,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e976aa99, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f9f9754}, log id: 2cce73f3 >2013-12-04 06:35:48,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 152ff7b5 >2013-12-04 06:35:48,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 152ff7b5 >2013-12-04 06:35:48,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 38b6d925 >2013-12-04 06:35:48,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b42da6b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9aac1c4c}, log id: 38b6d925 >2013-12-04 06:35:53,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 269b3526 >2013-12-04 06:35:54,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 269b3526 >2013-12-04 06:35:54,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6920583d >2013-12-04 06:35:54,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa1ed1b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7437008d}, log id: 6920583d >2013-12-04 06:35:55,337 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) No up server in cluster >2013-12-04 06:35:55,337 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:35:55,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 917b492 >2013-12-04 06:35:55,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterTasksListVDSCommand, return: [], log id: 917b492 >2013-12-04 06:35:59,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3611a10 >2013-12-04 06:36:00,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3611a10 >2013-12-04 06:36:00,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5d4b843f >2013-12-04 06:36:00,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5efad958, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bdc5c20}, log id: 5d4b843f >2013-12-04 06:36:05,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3e949bc3 >2013-12-04 06:36:06,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e949bc3 >2013-12-04 06:36:06,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4e65f2da >2013-12-04 06:36:06,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@545509d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7fe5b59}, log id: 4e65f2da >2013-12-04 06:36:11,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78cf8cac >2013-12-04 06:36:11,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 78cf8cac >2013-12-04 06:36:11,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79ecf0ef >2013-12-04 06:36:12,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ae1ae85, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89738a7e}, log id: 79ecf0ef >2013-12-04 06:36:17,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40dacda3 >2013-12-04 06:36:17,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 40dacda3 >2013-12-04 06:36:17,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5e5aa35d >2013-12-04 06:36:17,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fc43089, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c3a9dc}, log id: 5e5aa35d >2013-12-04 06:36:22,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4990fbe1 >2013-12-04 06:36:23,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4990fbe1 >2013-12-04 06:36:23,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 99b5086 >2013-12-04 06:36:23,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@724ca1b4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7d09b0d}, log id: 99b5086 >2013-12-04 06:36:28,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: cd29713 >2013-12-04 06:36:29,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: cd29713 >2013-12-04 06:36:29,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14d4c547 >2013-12-04 06:36:29,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31beb833, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2aa022a1}, log id: 14d4c547 >2013-12-04 06:36:34,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f4f07e6 >2013-12-04 06:36:35,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3f4f07e6 >2013-12-04 06:36:35,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79c94263 >2013-12-04 06:36:35,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@114a9411, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92c14d9e}, log id: 79c94263 >2013-12-04 06:36:40,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 117c943b >2013-12-04 06:36:41,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 117c943b >2013-12-04 06:36:41,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e5f21eb >2013-12-04 06:36:41,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78d5cd45, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15c97f5f}, log id: 3e5f21eb >2013-12-04 06:36:46,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 394fba14 >2013-12-04 06:36:46,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 394fba14 >2013-12-04 06:36:46,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 64b5781d >2013-12-04 06:36:47,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3674d6d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cc1389a}, log id: 64b5781d >2013-12-04 06:36:52,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 641fb30b >2013-12-04 06:36:52,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 641fb30b >2013-12-04 06:36:52,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 13402a53 >2013-12-04 06:36:52,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11944c22, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a56ffb8}, log id: 13402a53 >2013-12-04 06:36:55,637 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) No up server in cluster >2013-12-04 06:36:55,641 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:36:55,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 101b8b2a >2013-12-04 06:36:55,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, return: [], log id: 101b8b2a >2013-12-04 06:36:57,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3c8bad37 >2013-12-04 06:36:58,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c8bad37 >2013-12-04 06:36:58,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 411f4d33 >2013-12-04 06:36:58,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea0ef013, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9577c317}, log id: 411f4d33 >2013-12-04 06:37:03,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4fe8ca31 >2013-12-04 06:37:04,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4fe8ca31 >2013-12-04 06:37:04,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39f8a33e >2013-12-04 06:37:04,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7f289e8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35f75a58}, log id: 39f8a33e >2013-12-04 06:37:09,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 8023d53 >2013-12-04 06:37:10,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 8023d53 >2013-12-04 06:37:10,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f7301cf >2013-12-04 06:37:10,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd5b6ce3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5930e1c}, log id: 5f7301cf >2013-12-04 06:37:15,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4cd22c35 >2013-12-04 06:37:15,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4cd22c35 >2013-12-04 06:37:15,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 193ae6b >2013-12-04 06:37:16,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90ff47c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@754e69cd}, log id: 193ae6b >2013-12-04 06:37:21,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7c37fe20 >2013-12-04 06:37:21,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c37fe20 >2013-12-04 06:37:21,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 60fb8085 >2013-12-04 06:37:22,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8bfd7dc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f4d585b}, log id: 60fb8085 >2013-12-04 06:37:27,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2e3fa02f >2013-12-04 06:37:27,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e3fa02f >2013-12-04 06:37:27,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 75f8c6a0 >2013-12-04 06:37:27,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57fd9a5b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f9aade6}, log id: 75f8c6a0 >2013-12-04 06:37:32,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 138be02d >2013-12-04 06:37:33,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 138be02d >2013-12-04 06:37:33,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 462f5b5f >2013-12-04 06:37:33,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ffe6396, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b29c3754}, log id: 462f5b5f >2013-12-04 06:37:38,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1197f088 >2013-12-04 06:37:39,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1197f088 >2013-12-04 06:37:39,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28ae02a6 >2013-12-04 06:37:39,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89bbd0b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39be931b}, log id: 28ae02a6 >2013-12-04 06:37:44,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d601413 >2013-12-04 06:37:45,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: d601413 >2013-12-04 06:37:45,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 214c1a25 >2013-12-04 06:37:45,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7aed964, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac97653b}, log id: 214c1a25 >2013-12-04 06:37:50,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7baf7fa6 >2013-12-04 06:37:50,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7baf7fa6 >2013-12-04 06:37:50,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6aff5b3c >2013-12-04 06:37:51,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@486b2312, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2954702f}, log id: 6aff5b3c >2013-12-04 06:37:55,958 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-04 06:37:55,958 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:37:55,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 484976e1 >2013-12-04 06:37:56,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 57c02a24 >2013-12-04 06:37:56,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 484976e1 >2013-12-04 06:37:56,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 57c02a24 >2013-12-04 06:37:56,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d08090a >2013-12-04 06:37:56,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19be1ac3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0acc78c}, log id: 2d08090a >2013-12-04 06:38:01,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 169c9192 >2013-12-04 06:38:02,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 169c9192 >2013-12-04 06:38:02,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1cd17593 >2013-12-04 06:38:02,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34e3b183, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c255c250}, log id: 1cd17593 >2013-12-04 06:38:07,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 688bbf31 >2013-12-04 06:38:08,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 688bbf31 >2013-12-04 06:38:08,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3fe7a68a >2013-12-04 06:38:08,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec550a34, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b76c6204}, log id: 3fe7a68a >2013-12-04 06:38:13,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2cc3544f >2013-12-04 06:38:14,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2cc3544f >2013-12-04 06:38:14,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 43f51615 >2013-12-04 06:38:14,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@952d646e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc1ad952}, log id: 43f51615 >2013-12-04 06:38:19,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39472520 >2013-12-04 06:38:19,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 39472520 >2013-12-04 06:38:19,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 68199f06 >2013-12-04 06:38:20,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91f90a26, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1865772}, log id: 68199f06 >2013-12-04 06:38:25,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 73d1c622 >2013-12-04 06:38:25,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 73d1c622 >2013-12-04 06:38:25,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4381cc80 >2013-12-04 06:38:26,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e544146, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@902a6b82}, log id: 4381cc80 >2013-12-04 06:38:31,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 270506f >2013-12-04 06:38:31,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 270506f >2013-12-04 06:38:31,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7b3af30a >2013-12-04 06:38:31,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@565a2ae0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@713da9e5}, log id: 7b3af30a >2013-12-04 06:38:36,749 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to update VMs/Templates Ovf. >2013-12-04 06:38:36,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c63935d >2013-12-04 06:38:36,893 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-96) Start refreshing all users data >2013-12-04 06:38:37,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2c63935d >2013-12-04 06:38:37,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7bf546c9 >2013-12-04 06:38:37,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dac30a39, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25f78a8b}, log id: 7bf546c9 >2013-12-04 06:38:38,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-42) START, GlusterHooksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1c9696d0 >2013-12-04 06:38:38,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-50) START, GlusterHooksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 62874059 >2013-12-04 06:38:38,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-49) START, GlusterHooksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 42f4759 >2013-12-04 06:38:38,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-25) START, GlusterHooksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f2382f >2013-12-04 06:38:38,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-50) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@afa2932b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4bc99fde, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@aee31296, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@11daf61e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@69a88eef, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ffa41187, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@edfe84e], log id: 62874059 >2013-12-04 06:38:38,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-49) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6366779d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d7358a0f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@1e7b1c5f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@cad6381e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@35db5923, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@8785ecda, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@febf02fd], log id: 42f4759 >2013-12-04 06:38:39,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-25) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@7f912a5b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@13fe7a67, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f1b75e81, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f1d85899, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c1565f70, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f5395fdb, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4fbc1918], log id: 4f2382f >2013-12-04 06:38:39,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-42) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4224a04, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@827edc4d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@25267084, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b69555d6, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@715bf559, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3be7a8b2, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4fae6e32], log id: 1c9696d0 >2013-12-04 06:38:42,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6eec433e >2013-12-04 06:38:43,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6eec433e >2013-12-04 06:38:43,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ec763bb >2013-12-04 06:38:43,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93fb8a68, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afde81ff}, log id: 1ec763bb >2013-12-04 06:38:48,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ff4c1ef >2013-12-04 06:38:49,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3ff4c1ef >2013-12-04 06:38:49,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 481e9e70 >2013-12-04 06:38:49,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4644716d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63b6db61}, log id: 481e9e70 >2013-12-04 06:38:54,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54a49bd3 >2013-12-04 06:38:54,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 54a49bd3 >2013-12-04 06:38:54,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2499a399 >2013-12-04 06:38:55,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbadada2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8fa3629}, log id: 2499a399 >2013-12-04 06:38:56,279 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-04 06:38:56,279 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:38:56,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46f006fe >2013-12-04 06:38:56,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 46f006fe >2013-12-04 06:39:00,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 137f0e69 >2013-12-04 06:39:00,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 137f0e69 >2013-12-04 06:39:00,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3dd6afd >2013-12-04 06:39:00,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fff77619, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6b926f2}, log id: 3dd6afd >2013-12-04 06:39:05,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 478acdb1 >2013-12-04 06:39:06,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 478acdb1 >2013-12-04 06:39:06,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4972d5f5 >2013-12-04 06:39:06,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74c184b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a6a6528}, log id: 4972d5f5 >2013-12-04 06:39:10,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 513e15da >2013-12-04 06:39:10,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6c86ea34, log id: 513e15da >2013-12-04 06:39:10,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d7a3396 >2013-12-04 06:39:11,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@708832db, log id: d7a3396 >2013-12-04 06:39:11,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3eaddd16 >2013-12-04 06:39:12,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3eaddd16 >2013-12-04 06:39:12,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2a3dc68c >2013-12-04 06:39:12,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f462846, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb06038}, log id: 2a3dc68c >2013-12-04 06:39:17,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 322a80e0 >2013-12-04 06:39:18,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 322a80e0 >2013-12-04 06:39:18,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 144c9572 >2013-12-04 06:39:18,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cf82c51, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48a4f429}, log id: 144c9572 >2013-12-04 06:39:23,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d31ae79 >2013-12-04 06:39:23,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d31ae79 >2013-12-04 06:39:23,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 84c99f0 >2013-12-04 06:39:24,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b87f53c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@652bd107}, log id: 84c99f0 >2013-12-04 06:39:29,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a35c095 >2013-12-04 06:39:29,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a35c095 >2013-12-04 06:39:29,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a05dd12 >2013-12-04 06:39:29,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aacb63d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ad11d45}, log id: 4a05dd12 >2013-12-04 06:39:34,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 18e1e532 >2013-12-04 06:39:35,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 18e1e532 >2013-12-04 06:39:35,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6856e039 >2013-12-04 06:39:35,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf5a673d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5477ed42}, log id: 6856e039 >2013-12-04 06:39:40,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 61f35b91 >2013-12-04 06:39:41,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 61f35b91 >2013-12-04 06:39:41,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d5fe298 >2013-12-04 06:39:41,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76449dd2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5bd9197}, log id: 1d5fe298 >2013-12-04 06:39:46,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 10a7d282 >2013-12-04 06:39:47,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10a7d282 >2013-12-04 06:39:47,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 291881c6 >2013-12-04 06:39:47,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58466ff6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd6788fc}, log id: 291881c6 >2013-12-04 06:39:52,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 789f5ae1 >2013-12-04 06:39:52,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 789f5ae1 >2013-12-04 06:39:52,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16d71844 >2013-12-04 06:39:53,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70d22fdc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1b38e2e}, log id: 16d71844 >2013-12-04 06:39:56,589 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-04 06:39:56,589 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:39:56,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3120b040 >2013-12-04 06:39:56,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3120b040 >2013-12-04 06:39:58,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1acc2d58 >2013-12-04 06:39:58,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1acc2d58 >2013-12-04 06:39:58,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 72d504f2 >2013-12-04 06:39:59,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29424e37, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bada13c1}, log id: 72d504f2 >2013-12-04 06:40:04,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d83eafb >2013-12-04 06:40:04,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d83eafb >2013-12-04 06:40:04,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ae587a4 >2013-12-04 06:40:04,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba4cfacb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a453a32e}, log id: 6ae587a4 >2013-12-04 06:40:09,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 666b5e01 >2013-12-04 06:40:10,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 666b5e01 >2013-12-04 06:40:10,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6638c7cc >2013-12-04 06:40:10,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67ac41c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34819239}, log id: 6638c7cc >2013-12-04 06:40:15,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: e2fd558 >2013-12-04 06:40:16,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e2fd558 >2013-12-04 06:40:16,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1c41d8e7 >2013-12-04 06:40:16,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd3925cc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7050739}, log id: 1c41d8e7 >2013-12-04 06:40:21,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 768f02f6 >2013-12-04 06:40:22,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 768f02f6 >2013-12-04 06:40:22,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 23132133 >2013-12-04 06:40:22,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e76d4d38, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51084f4}, log id: 23132133 >2013-12-04 06:40:27,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 33afc376 >2013-12-04 06:40:27,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 33afc376 >2013-12-04 06:40:27,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 33513988 >2013-12-04 06:40:28,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51da49a5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c70a4aa}, log id: 33513988 >2013-12-04 06:40:33,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 227fed29 >2013-12-04 06:40:33,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 227fed29 >2013-12-04 06:40:33,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 369bfa6d >2013-12-04 06:40:34,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccaa35e1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31b26ffb}, log id: 369bfa6d >2013-12-04 06:40:39,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b3cebac >2013-12-04 06:40:39,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4b3cebac >2013-12-04 06:40:39,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 35516cee >2013-12-04 06:40:39,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3fd1859, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d557a17}, log id: 35516cee >2013-12-04 06:40:44,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2800c54d >2013-12-04 06:40:45,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2800c54d >2013-12-04 06:40:45,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3da0f52d >2013-12-04 06:40:45,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca33d86e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b07a9d5a}, log id: 3da0f52d >2013-12-04 06:40:50,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b0de6ce >2013-12-04 06:40:51,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b0de6ce >2013-12-04 06:40:51,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 686fd91c >2013-12-04 06:40:51,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72182f63, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bcee876}, log id: 686fd91c >2013-12-04 06:40:56,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 916752a >2013-12-04 06:40:56,897 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) No up server in cluster >2013-12-04 06:40:56,897 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:40:56,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2a552aeb >2013-12-04 06:40:57,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 916752a >2013-12-04 06:40:57,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c9689dc >2013-12-04 06:40:57,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2a552aeb >2013-12-04 06:40:57,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae38c581, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77ab455c}, log id: 4c9689dc >2013-12-04 06:41:02,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1dd09f01 >2013-12-04 06:41:02,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1dd09f01 >2013-12-04 06:41:02,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 22887fce >2013-12-04 06:41:03,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6422bc4f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dca4ba67}, log id: 22887fce >2013-12-04 06:41:08,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 778f2034 >2013-12-04 06:41:08,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 778f2034 >2013-12-04 06:41:08,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2875e972 >2013-12-04 06:41:08,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@273e1c50, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c36e95b2}, log id: 2875e972 >2013-12-04 06:41:13,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2deefb64 >2013-12-04 06:41:14,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2deefb64 >2013-12-04 06:41:14,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 12feb5c0 >2013-12-04 06:41:14,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2422b1b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@308a27f1}, log id: 12feb5c0 >2013-12-04 06:41:19,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 49678ff >2013-12-04 06:41:20,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 49678ff >2013-12-04 06:41:20,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 51c93970 >2013-12-04 06:41:20,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8813fd2b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83b9e755}, log id: 51c93970 >2013-12-04 06:41:25,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1dc11af7 >2013-12-04 06:41:26,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dc11af7 >2013-12-04 06:41:26,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b961d98 >2013-12-04 06:41:26,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6674d877, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4facd1e}, log id: 5b961d98 >2013-12-04 06:41:31,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3608491 >2013-12-04 06:41:31,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3608491 >2013-12-04 06:41:31,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 752b2888 >2013-12-04 06:41:32,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61d9d0c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e1e9bfe}, log id: 752b2888 >2013-12-04 06:41:37,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 66462dae >2013-12-04 06:41:37,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66462dae >2013-12-04 06:41:37,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5f67ae64 >2013-12-04 06:41:38,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c45ef9e2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2c463ae}, log id: 5f67ae64 >2013-12-04 06:41:43,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3bb67791 >2013-12-04 06:41:43,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3bb67791 >2013-12-04 06:41:43,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 267f87c8 >2013-12-04 06:41:43,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bd667ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f21293cf}, log id: 267f87c8 >2013-12-04 06:41:48,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 275aa435 >2013-12-04 06:41:49,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 275aa435 >2013-12-04 06:41:49,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b2624a5 >2013-12-04 06:41:49,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e00b1df, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84b412f2}, log id: 3b2624a5 >2013-12-04 06:41:54,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7dd5c9a2 >2013-12-04 06:41:55,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7dd5c9a2 >2013-12-04 06:41:55,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 415e7311 >2013-12-04 06:41:55,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99fbb3e5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@639210c3}, log id: 415e7311 >2013-12-04 06:41:57,218 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-04 06:41:57,218 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:41:57,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 78d5b745 >2013-12-04 06:41:57,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 78d5b745 >2013-12-04 06:42:00,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 106ce661 >2013-12-04 06:42:01,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 106ce661 >2013-12-04 06:42:01,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4349aca >2013-12-04 06:42:01,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5861b47, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83c697b5}, log id: 4349aca >2013-12-04 06:42:06,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2bf1e6c9 >2013-12-04 06:42:06,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bf1e6c9 >2013-12-04 06:42:06,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39ee0a55 >2013-12-04 06:42:07,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfc0d5af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c72211f5}, log id: 39ee0a55 >2013-12-04 06:42:12,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30d4b9d9 >2013-12-04 06:42:12,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 30d4b9d9 >2013-12-04 06:42:12,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39f959df >2013-12-04 06:42:12,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adc78298, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2286131a}, log id: 39f959df >2013-12-04 06:42:18,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c593f14 >2013-12-04 06:42:18,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c593f14 >2013-12-04 06:42:18,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 48dd9ae8 >2013-12-04 06:42:18,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1fbcbef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4efa15c5}, log id: 48dd9ae8 >2013-12-04 06:42:23,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1e10f2bf >2013-12-04 06:42:24,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e10f2bf >2013-12-04 06:42:24,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29909d6 >2013-12-04 06:42:24,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b983a4a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa8cf68}, log id: 29909d6 >2013-12-04 06:42:29,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1f23bb67 >2013-12-04 06:42:30,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f23bb67 >2013-12-04 06:42:30,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5e2dfe5a >2013-12-04 06:42:30,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@898db1c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59971d9d}, log id: 5e2dfe5a >2013-12-04 06:42:35,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ef6b9b4 >2013-12-04 06:42:35,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ef6b9b4 >2013-12-04 06:42:35,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4e0f1c8b >2013-12-04 06:42:36,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ebca0b4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12a08730}, log id: 4e0f1c8b >2013-12-04 06:42:41,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e1fcdb9 >2013-12-04 06:42:41,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e1fcdb9 >2013-12-04 06:42:41,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45d41eb2 >2013-12-04 06:42:42,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b88b999, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fffe16b}, log id: 45d41eb2 >2013-12-04 06:42:47,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 52482f8b >2013-12-04 06:42:47,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 52482f8b >2013-12-04 06:42:47,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b436f98 >2013-12-04 06:42:47,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c87242d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88dedb2f}, log id: 6b436f98 >2013-12-04 06:42:52,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 66664286 >2013-12-04 06:42:53,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 66664286 >2013-12-04 06:42:53,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39ac6da >2013-12-04 06:42:53,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c506d47b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8520621a}, log id: 39ac6da >2013-12-04 06:42:57,535 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-04 06:42:57,535 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:42:57,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f85f38 >2013-12-04 06:42:57,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5f85f38 >2013-12-04 06:42:58,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5e55a00a >2013-12-04 06:42:59,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e55a00a >2013-12-04 06:42:59,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 79df477a >2013-12-04 06:42:59,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be07d64a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a325b90}, log id: 79df477a >2013-12-04 06:43:04,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 712dd9b3 >2013-12-04 06:43:05,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 712dd9b3 >2013-12-04 06:43:05,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 65c5323b >2013-12-04 06:43:05,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ce2cd8d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90b9b389}, log id: 65c5323b >2013-12-04 06:43:10,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1e0c6b46 >2013-12-04 06:43:10,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e0c6b46 >2013-12-04 06:43:10,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 9afc70 >2013-12-04 06:43:11,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@657c12d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f914a76}, log id: 9afc70 >2013-12-04 06:43:16,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5639086d >2013-12-04 06:43:16,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5639086d >2013-12-04 06:43:16,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43061690 >2013-12-04 06:43:16,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56b9720e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1ff3206}, log id: 43061690 >2013-12-04 06:43:21,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 61aed2d6 >2013-12-04 06:43:22,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61aed2d6 >2013-12-04 06:43:22,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 31aaab4d >2013-12-04 06:43:22,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f035dfb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aeb37fe7}, log id: 31aaab4d >2013-12-04 06:43:27,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7e79bb4c >2013-12-04 06:43:28,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e79bb4c >2013-12-04 06:43:28,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 50a09ff4 >2013-12-04 06:43:28,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac23f1ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a929728d}, log id: 50a09ff4 >2013-12-04 06:43:33,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7130fde6 >2013-12-04 06:43:34,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7130fde6 >2013-12-04 06:43:34,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c6f347a >2013-12-04 06:43:34,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed5879fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a84a894}, log id: 2c6f347a >2013-12-04 06:43:39,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2a5ad1ff >2013-12-04 06:43:39,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a5ad1ff >2013-12-04 06:43:39,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7c223a6d >2013-12-04 06:43:40,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70b9ebc0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2639752e}, log id: 7c223a6d >2013-12-04 06:43:45,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29b51a7d >2013-12-04 06:43:45,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 29b51a7d >2013-12-04 06:43:45,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 74d5f13d >2013-12-04 06:43:46,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c4041ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ecaa54a9}, log id: 74d5f13d >2013-12-04 06:43:51,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 234543 >2013-12-04 06:43:51,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 234543 >2013-12-04 06:43:51,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3ea1f3b >2013-12-04 06:43:51,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@653ad23a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d2846d9}, log id: 3ea1f3b >2013-12-04 06:43:56,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 35fbfb7f >2013-12-04 06:43:57,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 35fbfb7f >2013-12-04 06:43:57,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ef62537 >2013-12-04 06:43:57,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbc7a00d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50a59c19}, log id: 2ef62537 >2013-12-04 06:43:57,860 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2013-12-04 06:43:57,860 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:43:57,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10fbd157 >2013-12-04 06:43:58,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 10fbd157 >2013-12-04 06:44:02,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7bab3384 >2013-12-04 06:44:03,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7bab3384 >2013-12-04 06:44:03,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b6406ab >2013-12-04 06:44:03,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7959fd7d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37904618}, log id: 4b6406ab >2013-12-04 06:44:08,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7dab84c6 >2013-12-04 06:44:09,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7dab84c6 >2013-12-04 06:44:09,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 60c0e8e3 >2013-12-04 06:44:09,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@136edd97, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc5fea91}, log id: 60c0e8e3 >2013-12-04 06:44:11,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1c0c88f >2013-12-04 06:44:11,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6eb81b0a, log id: 1c0c88f >2013-12-04 06:44:11,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 78f7664f >2013-12-04 06:44:11,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@363b591b, log id: 78f7664f >2013-12-04 06:44:14,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d26c5e3 >2013-12-04 06:44:14,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d26c5e3 >2013-12-04 06:44:14,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73c811a0 >2013-12-04 06:44:15,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc2d4c23, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@197b8fa8}, log id: 73c811a0 >2013-12-04 06:44:20,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 108fa30a >2013-12-04 06:44:20,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 108fa30a >2013-12-04 06:44:20,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c93c563 >2013-12-04 06:44:20,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@696c205b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c87019ac}, log id: 4c93c563 >2013-12-04 06:44:26,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ab6b8c1 >2013-12-04 06:44:26,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ab6b8c1 >2013-12-04 06:44:26,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6bc63892 >2013-12-04 06:44:26,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f627b6c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ab87f13}, log id: 6bc63892 >2013-12-04 06:44:31,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5db22161 >2013-12-04 06:44:32,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5db22161 >2013-12-04 06:44:32,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4839df88 >2013-12-04 06:44:32,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@656947f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@941fe1f4}, log id: 4839df88 >2013-12-04 06:44:37,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1307e2e1 >2013-12-04 06:44:38,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1307e2e1 >2013-12-04 06:44:38,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15708d71 >2013-12-04 06:44:38,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d2a6d9a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad1c3fe7}, log id: 15708d71 >2013-12-04 06:44:43,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2052ec20 >2013-12-04 06:44:44,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2052ec20 >2013-12-04 06:44:44,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1e10639f >2013-12-04 06:44:44,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b64bf2f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eea82679}, log id: 1e10639f >2013-12-04 06:44:49,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57f2cbbd >2013-12-04 06:44:49,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 57f2cbbd >2013-12-04 06:44:49,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d02a519 >2013-12-04 06:44:50,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ee99c72, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70932e77}, log id: 1d02a519 >2013-12-04 06:44:55,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d01a316 >2013-12-04 06:44:55,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d01a316 >2013-12-04 06:44:55,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 16145897 >2013-12-04 06:44:55,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2f534a7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fc6d012}, log id: 16145897 >2013-12-04 06:44:58,171 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) No up server in cluster >2013-12-04 06:44:58,172 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:44:58,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4be5cc9b >2013-12-04 06:44:58,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4be5cc9b >2013-12-04 06:45:01,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 123bf357 >2013-12-04 06:45:01,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 123bf357 >2013-12-04 06:45:01,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2a988b84 >2013-12-04 06:45:01,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f01be52, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@594fb1c0}, log id: 2a988b84 >2013-12-04 06:45:06,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 389993e9 >2013-12-04 06:45:07,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 389993e9 >2013-12-04 06:45:07,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f693b62 >2013-12-04 06:45:07,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@896e8174, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6d91c18}, log id: 3f693b62 >2013-12-04 06:45:12,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32371fc4 >2013-12-04 06:45:13,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 32371fc4 >2013-12-04 06:45:13,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4e228063 >2013-12-04 06:45:13,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abb85d42, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bfacdc6}, log id: 4e228063 >2013-12-04 06:45:18,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7224b140 >2013-12-04 06:45:19,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7224b140 >2013-12-04 06:45:19,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b5e9fdf >2013-12-04 06:45:19,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a440415, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ee2207e}, log id: 1b5e9fdf >2013-12-04 06:45:24,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3658fe25 >2013-12-04 06:45:24,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3658fe25 >2013-12-04 06:45:24,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7196c4a1 >2013-12-04 06:45:25,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ca21bbf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@192100ef}, log id: 7196c4a1 >2013-12-04 06:45:30,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5cc91a23 >2013-12-04 06:45:30,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5cc91a23 >2013-12-04 06:45:30,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55a37939 >2013-12-04 06:45:30,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9090c8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@207efd4d}, log id: 55a37939 >2013-12-04 06:45:35,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2b3bc690 >2013-12-04 06:45:36,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b3bc690 >2013-12-04 06:45:36,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 66d7dae4 >2013-12-04 06:45:36,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f97ad07f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19f0e40a}, log id: 66d7dae4 >2013-12-04 06:45:41,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 712842b3 >2013-12-04 06:45:42,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 712842b3 >2013-12-04 06:45:42,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ea1e0d1 >2013-12-04 06:45:42,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0cc2856, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbd4fc23}, log id: 4ea1e0d1 >2013-12-04 06:45:47,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1d6dcb7b >2013-12-04 06:45:48,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d6dcb7b >2013-12-04 06:45:48,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 370f9bb2 >2013-12-04 06:45:48,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13d23975, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1c3532d}, log id: 370f9bb2 >2013-12-04 06:45:53,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 38d2641b >2013-12-04 06:45:53,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 38d2641b >2013-12-04 06:45:53,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: cd1fdd1 >2013-12-04 06:45:54,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@622a681f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a8fab96}, log id: cd1fdd1 >2013-12-04 06:45:58,510 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) No up server in cluster >2013-12-04 06:45:58,510 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:45:58,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ced7326 >2013-12-04 06:45:58,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, return: [], log id: ced7326 >2013-12-04 06:45:59,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4ff71ea5 >2013-12-04 06:45:59,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ff71ea5 >2013-12-04 06:45:59,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 65f2ae06 >2013-12-04 06:46:00,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@512e1b79, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8964579}, log id: 65f2ae06 >2013-12-04 06:46:05,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7286bd69 >2013-12-04 06:46:05,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7286bd69 >2013-12-04 06:46:05,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4cb3c5ea >2013-12-04 06:46:05,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@504e804e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea431b7}, log id: 4cb3c5ea >2013-12-04 06:46:10,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b461021 >2013-12-04 06:46:11,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b461021 >2013-12-04 06:46:11,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7646130d >2013-12-04 06:46:11,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eda17a50, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4e5cbd}, log id: 7646130d >2013-12-04 06:46:16,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1dd51553 >2013-12-04 06:46:17,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dd51553 >2013-12-04 06:46:17,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a9e71e4 >2013-12-04 06:46:17,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83f3d8f2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65029e8a}, log id: 3a9e71e4 >2013-12-04 06:46:22,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c45c852 >2013-12-04 06:46:23,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4c45c852 >2013-12-04 06:46:23,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 798ecb00 >2013-12-04 06:46:23,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72f350d4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f5d8b51}, log id: 798ecb00 >2013-12-04 06:46:28,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 24484a21 >2013-12-04 06:46:28,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 24484a21 >2013-12-04 06:46:28,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1641d666 >2013-12-04 06:46:29,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bc98992, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0434b01}, log id: 1641d666 >2013-12-04 06:46:34,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a72d163 >2013-12-04 06:46:34,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a72d163 >2013-12-04 06:46:34,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9193987 >2013-12-04 06:46:34,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf5a3cca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e35406d}, log id: 9193987 >2013-12-04 06:46:40,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 78170691 >2013-12-04 06:46:40,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78170691 >2013-12-04 06:46:40,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 538909af >2013-12-04 06:46:40,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7110d140, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92449472}, log id: 538909af >2013-12-04 06:46:45,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 513bf69 >2013-12-04 06:46:46,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 513bf69 >2013-12-04 06:46:46,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ccee199 >2013-12-04 06:46:46,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b67ba9ad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53e48f65}, log id: 1ccee199 >2013-12-04 06:46:51,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 55ba64a4 >2013-12-04 06:46:52,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 55ba64a4 >2013-12-04 06:46:52,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 15bd33b1 >2013-12-04 06:46:52,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c05f9549, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ff511df}, log id: 15bd33b1 >2013-12-04 06:46:57,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 55e2b064 >2013-12-04 06:46:57,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 55e2b064 >2013-12-04 06:46:57,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4fe40885 >2013-12-04 06:46:58,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a4f59e6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ae5e7e7}, log id: 4fe40885 >2013-12-04 06:46:58,820 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-04 06:46:58,820 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:46:58,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7c0da4e2 >2013-12-04 06:46:59,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7c0da4e2 >2013-12-04 06:47:03,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 48065d22 >2013-12-04 06:47:03,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 48065d22 >2013-12-04 06:47:03,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d16df59 >2013-12-04 06:47:03,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4432d74f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5d2be1e}, log id: 3d16df59 >2013-12-04 06:47:08,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 613fce4d >2013-12-04 06:47:09,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 613fce4d >2013-12-04 06:47:09,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b8594fa >2013-12-04 06:47:09,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4eeeda6f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@586aea49}, log id: 1b8594fa >2013-12-04 06:47:14,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5e31a9a9 >2013-12-04 06:47:15,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e31a9a9 >2013-12-04 06:47:15,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2ebb1904 >2013-12-04 06:47:15,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf9a67e3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70dcafb8}, log id: 2ebb1904 >2013-12-04 06:47:20,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1126713 >2013-12-04 06:47:21,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1126713 >2013-12-04 06:47:21,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 505ee896 >2013-12-04 06:47:21,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b77cdefe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21252137}, log id: 505ee896 >2013-12-04 06:47:26,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2245c835 >2013-12-04 06:47:26,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2245c835 >2013-12-04 06:47:26,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 349634f9 >2013-12-04 06:47:27,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b43557c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25cfbcc}, log id: 349634f9 >2013-12-04 06:47:32,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 34b7994c >2013-12-04 06:47:32,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 34b7994c >2013-12-04 06:47:32,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 69e241e9 >2013-12-04 06:47:33,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25543d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e4db8e3}, log id: 69e241e9 >2013-12-04 06:47:38,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 72cbb44e >2013-12-04 06:47:38,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 72cbb44e >2013-12-04 06:47:38,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 452e1b28 >2013-12-04 06:47:38,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38f04cfc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fe9d78c}, log id: 452e1b28 >2013-12-04 06:47:43,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 32866a5 >2013-12-04 06:47:44,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 32866a5 >2013-12-04 06:47:44,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1822849f >2013-12-04 06:47:44,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54cf4102, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0f524e5}, log id: 1822849f >2013-12-04 06:47:49,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 17a2a8c0 >2013-12-04 06:47:50,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 17a2a8c0 >2013-12-04 06:47:50,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 150cceac >2013-12-04 06:47:50,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33dd454f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c929756}, log id: 150cceac >2013-12-04 06:47:55,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a0d22d2 >2013-12-04 06:47:56,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a0d22d2 >2013-12-04 06:47:56,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 46cf9ed1 >2013-12-04 06:47:56,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db841891, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3b0c60e}, log id: 46cf9ed1 >2013-12-04 06:47:59,128 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) [3f45b52d] No up server in cluster >2013-12-04 06:47:59,128 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) [3f45b52d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:47:59,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e54be4d >2013-12-04 06:47:59,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 2e54be4d >2013-12-04 06:48:01,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12839e20 >2013-12-04 06:48:01,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 12839e20 >2013-12-04 06:48:01,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b340054 >2013-12-04 06:48:02,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76503ede, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de77dca3}, log id: 6b340054 >2013-12-04 06:48:07,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a01ae4e >2013-12-04 06:48:07,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a01ae4e >2013-12-04 06:48:07,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 199461ad >2013-12-04 06:48:08,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95ef2bd2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b20ed08}, log id: 199461ad >2013-12-04 06:48:13,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: c3d0cf5 >2013-12-04 06:48:13,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c3d0cf5 >2013-12-04 06:48:13,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5bafce5 >2013-12-04 06:48:13,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f5d292f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce555ea2}, log id: 5bafce5 >2013-12-04 06:48:18,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 77b728e5 >2013-12-04 06:48:19,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77b728e5 >2013-12-04 06:48:19,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5dc320bd >2013-12-04 06:48:19,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc50f612, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@786a7139}, log id: 5dc320bd >2013-12-04 06:48:24,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3dfe668f >2013-12-04 06:48:25,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3dfe668f >2013-12-04 06:48:25,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 26d57507 >2013-12-04 06:48:25,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2727663, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85abb973}, log id: 26d57507 >2013-12-04 06:48:30,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 647aa4d0 >2013-12-04 06:48:31,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 647aa4d0 >2013-12-04 06:48:31,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 48836f33 >2013-12-04 06:48:31,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7460b912, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eca913c4}, log id: 48836f33 >2013-12-04 06:48:36,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c58ed17 >2013-12-04 06:48:36,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c58ed17 >2013-12-04 06:48:36,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 253ae39f >2013-12-04 06:48:37,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e915136c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52bdb8af}, log id: 253ae39f >2013-12-04 06:48:42,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 601a4725 >2013-12-04 06:48:42,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 601a4725 >2013-12-04 06:48:42,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f3b6f0f >2013-12-04 06:48:42,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcb6cbe1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b27e6eed}, log id: 7f3b6f0f >2013-12-04 06:48:48,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3696b149 >2013-12-04 06:48:48,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3696b149 >2013-12-04 06:48:48,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a873077 >2013-12-04 06:48:48,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42a6d7e8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd0b9b63}, log id: 1a873077 >2013-12-04 06:48:53,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f2d1070 >2013-12-04 06:48:54,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4f2d1070 >2013-12-04 06:48:54,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7058fbf8 >2013-12-04 06:48:54,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fa76298, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e929c93}, log id: 7058fbf8 >2013-12-04 06:48:59,448 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) No up server in cluster >2013-12-04 06:48:59,448 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:48:59,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7920c731 >2013-12-04 06:48:59,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 13ebaa84 >2013-12-04 06:48:59,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7920c731 >2013-12-04 06:49:00,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 13ebaa84 >2013-12-04 06:49:00,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b4191be >2013-12-04 06:49:00,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebc4bf0d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9132871}, log id: 6b4191be >2013-12-04 06:49:05,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70432212 >2013-12-04 06:49:05,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 70432212 >2013-12-04 06:49:06,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2c2c3a2 >2013-12-04 06:49:06,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15b94a50, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac9c5cc8}, log id: 2c2c3a2 >2013-12-04 06:49:11,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 152ab9e7 >2013-12-04 06:49:11,729 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-59) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 06:49:11,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 152ab9e7 >2013-12-04 06:49:11,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3f3d6c58 >2013-12-04 06:49:11,803 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-59) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 06:49:11,814 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-59) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 06:49:12,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e50470ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fecd170}, log id: 3f3d6c58 >2013-12-04 06:49:12,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17142200 >2013-12-04 06:49:12,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@e0dba92, log id: 17142200 >2013-12-04 06:49:12,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2753ce73 >2013-12-04 06:49:12,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@23556024, log id: 2753ce73 >2013-12-04 06:49:17,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2305e45f >2013-12-04 06:49:17,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2305e45f >2013-12-04 06:49:17,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: dfa1f7d >2013-12-04 06:49:17,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2824187a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@973895fa}, log id: dfa1f7d >2013-12-04 06:49:22,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ff19c63 >2013-12-04 06:49:23,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5ff19c63 >2013-12-04 06:49:23,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d68e73d >2013-12-04 06:49:23,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@418ee763, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@537dcbff}, log id: 3d68e73d >2013-12-04 06:49:28,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1332c26e >2013-12-04 06:49:29,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1332c26e >2013-12-04 06:49:29,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 434f28b1 >2013-12-04 06:49:29,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3546a952, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15cfcddc}, log id: 434f28b1 >2013-12-04 06:49:34,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7151e8a3 >2013-12-04 06:49:35,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7151e8a3 >2013-12-04 06:49:35,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e12510f >2013-12-04 06:49:35,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bbfab87, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74c0ed20}, log id: 6e12510f >2013-12-04 06:49:40,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2834aa41 >2013-12-04 06:49:40,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2834aa41 >2013-12-04 06:49:40,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4861ef1f >2013-12-04 06:49:41,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7256885f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ad33d6b}, log id: 4861ef1f >2013-12-04 06:49:46,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42456e25 >2013-12-04 06:49:46,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 42456e25 >2013-12-04 06:49:46,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 511e6dec >2013-12-04 06:49:46,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24dbe5a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e659b6a}, log id: 511e6dec >2013-12-04 06:49:52,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 75ba0936 >2013-12-04 06:49:52,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75ba0936 >2013-12-04 06:49:52,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 51078575 >2013-12-04 06:49:52,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb69ce3f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d34b53c6}, log id: 51078575 >2013-12-04 06:49:57,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d7c4234 >2013-12-04 06:49:58,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d7c4234 >2013-12-04 06:49:58,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 31bfc66b >2013-12-04 06:49:58,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a98a1c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2679967d}, log id: 31bfc66b >2013-12-04 06:49:59,767 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) No up server in cluster >2013-12-04 06:49:59,767 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:49:59,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: f0f3b3e >2013-12-04 06:50:00,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterTasksListVDSCommand, return: [], log id: f0f3b3e >2013-12-04 06:50:03,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a76f682 >2013-12-04 06:50:04,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a76f682 >2013-12-04 06:50:04,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 74a02912 >2013-12-04 06:50:04,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1922708b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a47bdfe}, log id: 74a02912 >2013-12-04 06:50:09,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6d637771 >2013-12-04 06:50:10,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d637771 >2013-12-04 06:50:10,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 65a668b >2013-12-04 06:50:10,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b085799c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69aff784}, log id: 65a668b >2013-12-04 06:50:15,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4d720fb0 >2013-12-04 06:50:15,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d720fb0 >2013-12-04 06:50:15,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d1927da >2013-12-04 06:50:16,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d61e15f7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5680d07e}, log id: 2d1927da >2013-12-04 06:50:21,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 43aecb40 >2013-12-04 06:50:21,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43aecb40 >2013-12-04 06:50:21,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 60ae084f >2013-12-04 06:50:22,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54a1171, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b2c0817}, log id: 60ae084f >2013-12-04 06:50:27,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6fbcaa42 >2013-12-04 06:50:27,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fbcaa42 >2013-12-04 06:50:27,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: ca9fec9 >2013-12-04 06:50:27,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff1812d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa9d0751}, log id: ca9fec9 >2013-12-04 06:50:32,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9f1e14b >2013-12-04 06:50:33,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 9f1e14b >2013-12-04 06:50:33,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 51ce3527 >2013-12-04 06:50:33,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65defb05, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe907ff8}, log id: 51ce3527 >2013-12-04 06:50:38,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f828374 >2013-12-04 06:50:39,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: f828374 >2013-12-04 06:50:39,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 23877230 >2013-12-04 06:50:39,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88321aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5055c1b3}, log id: 23877230 >2013-12-04 06:50:44,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 346532e8 >2013-12-04 06:50:45,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 346532e8 >2013-12-04 06:50:45,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4da213b9 >2013-12-04 06:50:45,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a57647ad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cab8e14}, log id: 4da213b9 >2013-12-04 06:50:50,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 149330c8 >2013-12-04 06:50:50,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 149330c8 >2013-12-04 06:50:50,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5ab4da41 >2013-12-04 06:50:51,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b627c595, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4297d648}, log id: 5ab4da41 >2013-12-04 06:50:56,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a6c6a50 >2013-12-04 06:50:56,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a6c6a50 >2013-12-04 06:50:56,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7015ad70 >2013-12-04 06:50:57,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37ea6d01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7e84a97}, log id: 7015ad70 >2013-12-04 06:51:00,077 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-04 06:51:00,077 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:51:00,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2bfb15d8 >2013-12-04 06:51:00,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2bfb15d8 >2013-12-04 06:51:02,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1cd26aed >2013-12-04 06:51:02,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cd26aed >2013-12-04 06:51:02,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 772a6dd5 >2013-12-04 06:51:02,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3018c98, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9112c153}, log id: 772a6dd5 >2013-12-04 06:51:07,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22502397 >2013-12-04 06:51:08,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 22502397 >2013-12-04 06:51:08,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 56de7127 >2013-12-04 06:51:08,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5d31a26, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@140d61fd}, log id: 56de7127 >2013-12-04 06:51:13,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 31b020f1 >2013-12-04 06:51:14,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31b020f1 >2013-12-04 06:51:14,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2ee9b9ec >2013-12-04 06:51:14,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35b0663b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5674cb5}, log id: 2ee9b9ec >2013-12-04 06:51:19,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 37060722 >2013-12-04 06:51:20,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37060722 >2013-12-04 06:51:20,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2edf0a42 >2013-12-04 06:51:20,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab49ef55, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6684aa1c}, log id: 2edf0a42 >2013-12-04 06:51:25,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ecda451 >2013-12-04 06:51:25,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ecda451 >2013-12-04 06:51:25,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6be144fe >2013-12-04 06:51:26,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98e3f713, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@742c778d}, log id: 6be144fe >2013-12-04 06:51:31,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 742531a1 >2013-12-04 06:51:31,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 742531a1 >2013-12-04 06:51:31,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25123b49 >2013-12-04 06:51:32,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@594802c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9264473e}, log id: 25123b49 >2013-12-04 06:51:37,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3549389a >2013-12-04 06:51:37,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3549389a >2013-12-04 06:51:37,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 55ab42aa >2013-12-04 06:51:37,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a370ecc6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19462793}, log id: 55ab42aa >2013-12-04 06:51:42,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18dfd2f4 >2013-12-04 06:51:43,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 18dfd2f4 >2013-12-04 06:51:43,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2cf4d7ca >2013-12-04 06:51:43,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f840ece5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a6e8a17}, log id: 2cf4d7ca >2013-12-04 06:51:48,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a3cc2f9 >2013-12-04 06:51:49,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6a3cc2f9 >2013-12-04 06:51:49,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38d40c5c >2013-12-04 06:51:49,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5768c9d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83958e50}, log id: 38d40c5c >2013-12-04 06:51:54,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2912c776 >2013-12-04 06:51:55,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2912c776 >2013-12-04 06:51:55,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b9a2e69 >2013-12-04 06:51:55,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6b59339, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@107bb1bb}, log id: 6b9a2e69 >2013-12-04 06:52:00,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a7e06c4 >2013-12-04 06:52:00,389 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-04 06:52:00,389 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:52:00,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 416a2683 >2013-12-04 06:52:00,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 416a2683 >2013-12-04 06:52:00,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a7e06c4 >2013-12-04 06:52:00,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5251d056 >2013-12-04 06:52:01,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@977846b1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe34be4e}, log id: 5251d056 >2013-12-04 06:52:06,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 28c223e5 >2013-12-04 06:52:06,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 28c223e5 >2013-12-04 06:52:06,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 425225dd >2013-12-04 06:52:06,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd8c8f57, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9998713}, log id: 425225dd >2013-12-04 06:52:11,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d7a6300 >2013-12-04 06:52:12,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3d7a6300 >2013-12-04 06:52:12,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2f84b545 >2013-12-04 06:52:12,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c854aa36, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee2f577d}, log id: 2f84b545 >2013-12-04 06:52:17,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f6addd5 >2013-12-04 06:52:18,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3f6addd5 >2013-12-04 06:52:18,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d19fbaa >2013-12-04 06:52:18,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0c2659d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc9d9bf5}, log id: 2d19fbaa >2013-12-04 06:52:23,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ecc2065 >2013-12-04 06:52:24,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ecc2065 >2013-12-04 06:52:24,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30c0d34d >2013-12-04 06:52:24,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8d9e1ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@756e5454}, log id: 30c0d34d >2013-12-04 06:52:29,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1db4a6a9 >2013-12-04 06:52:29,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1db4a6a9 >2013-12-04 06:52:29,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1e6e7589 >2013-12-04 06:52:30,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4de11b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1895a58d}, log id: 1e6e7589 >2013-12-04 06:52:35,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 44f09a38 >2013-12-04 06:52:35,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 44f09a38 >2013-12-04 06:52:35,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4cf92c48 >2013-12-04 06:52:36,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@799eab66, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cddf5263}, log id: 4cf92c48 >2013-12-04 06:52:41,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 17f2d4b1 >2013-12-04 06:52:41,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 17f2d4b1 >2013-12-04 06:52:41,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e159fa5 >2013-12-04 06:52:41,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@216c5f20, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a254e8f2}, log id: 3e159fa5 >2013-12-04 06:52:46,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: e205cf6 >2013-12-04 06:52:47,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: e205cf6 >2013-12-04 06:52:47,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ee5694e >2013-12-04 06:52:47,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b9fff2c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3ac6622}, log id: 6ee5694e >2013-12-04 06:52:52,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5061d7d3 >2013-12-04 06:52:53,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5061d7d3 >2013-12-04 06:52:53,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 429db44 >2013-12-04 06:52:53,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7344f4b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f13a707f}, log id: 429db44 >2013-12-04 06:52:58,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2651a4b3 >2013-12-04 06:52:59,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2651a4b3 >2013-12-04 06:52:59,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78a8ed0d >2013-12-04 06:52:59,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0f338ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27bdfc00}, log id: 78a8ed0d >2013-12-04 06:53:00,704 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-04 06:53:00,704 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:53:00,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 51428af5 >2013-12-04 06:53:01,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: 51428af5 >2013-12-04 06:53:04,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 69e9900f >2013-12-04 06:53:04,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 69e9900f >2013-12-04 06:53:04,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54bc8895 >2013-12-04 06:53:05,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58e1971c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@642ee130}, log id: 54bc8895 >2013-12-04 06:53:10,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36448b2d >2013-12-04 06:53:10,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36448b2d >2013-12-04 06:53:10,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 13b3fa69 >2013-12-04 06:53:10,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@427480b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f34318d}, log id: 13b3fa69 >2013-12-04 06:53:15,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 732c6f12 >2013-12-04 06:53:16,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 732c6f12 >2013-12-04 06:53:16,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5822de9d >2013-12-04 06:53:16,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36480e25, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad56c98}, log id: 5822de9d >2013-12-04 06:53:21,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8c768c2 >2013-12-04 06:53:22,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 8c768c2 >2013-12-04 06:53:22,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 570ba69b >2013-12-04 06:53:22,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adaa7b1e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6aab9ea9}, log id: 570ba69b >2013-12-04 06:53:27,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 52610cb >2013-12-04 06:53:28,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 52610cb >2013-12-04 06:53:28,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d745b94 >2013-12-04 06:53:28,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcf6d496, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10c7dadd}, log id: 6d745b94 >2013-12-04 06:53:33,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c73d3e7 >2013-12-04 06:53:33,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: c73d3e7 >2013-12-04 06:53:33,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d49faf6 >2013-12-04 06:53:34,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdc2c867, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2083b76e}, log id: 2d49faf6 >2013-12-04 06:53:39,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2cb3bd14 >2013-12-04 06:53:39,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2cb3bd14 >2013-12-04 06:53:39,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 255fe612 >2013-12-04 06:53:40,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0e1ff53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ab0906}, log id: 255fe612 >2013-12-04 06:53:45,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1990ad19 >2013-12-04 06:53:45,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1990ad19 >2013-12-04 06:53:45,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f5a92d2 >2013-12-04 06:53:45,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13c7a0bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e256a36}, log id: 3f5a92d2 >2013-12-04 06:53:50,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7b9b9786 >2013-12-04 06:53:51,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b9b9786 >2013-12-04 06:53:51,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 621d06cd >2013-12-04 06:53:51,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a8860b4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22fe426d}, log id: 621d06cd >2013-12-04 06:53:56,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 51a1b493 >2013-12-04 06:53:57,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 51a1b493 >2013-12-04 06:53:57,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45d4f649 >2013-12-04 06:53:57,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28b5be17, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33538d1}, log id: 45d4f649 >2013-12-04 06:54:01,009 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-04 06:54:01,009 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:54:01,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16c96bf1 >2013-12-04 06:54:01,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 16c96bf1 >2013-12-04 06:54:02,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a09ad40 >2013-12-04 06:54:02,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a09ad40 >2013-12-04 06:54:03,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ee17a39 >2013-12-04 06:54:03,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9d5cce9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@907d40e7}, log id: 1ee17a39 >2013-12-04 06:54:08,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 26ce117d >2013-12-04 06:54:08,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 26ce117d >2013-12-04 06:54:08,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 52bba5a6 >2013-12-04 06:54:09,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@986caf8d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@192152c7}, log id: 52bba5a6 >2013-12-04 06:54:12,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: ace43e >2013-12-04 06:54:13,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5a804725, log id: ace43e >2013-12-04 06:54:13,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1bbefc8e >2013-12-04 06:54:13,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3b0f6fbe, log id: 1bbefc8e >2013-12-04 06:54:14,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 49bc9cd8 >2013-12-04 06:54:14,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 49bc9cd8 >2013-12-04 06:54:14,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a2ab8d8 >2013-12-04 06:54:14,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1f6946, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e3c659c}, log id: 3a2ab8d8 >2013-12-04 06:54:19,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3294f961 >2013-12-04 06:54:20,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3294f961 >2013-12-04 06:54:20,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 479830c4 >2013-12-04 06:54:20,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b1ca8df, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c79dd73}, log id: 479830c4 >2013-12-04 06:54:25,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 35fc72b5 >2013-12-04 06:54:26,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 35fc72b5 >2013-12-04 06:54:26,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43411c0a >2013-12-04 06:54:26,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aedb3c7c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c71631e}, log id: 43411c0a >2013-12-04 06:54:31,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78986d5c >2013-12-04 06:54:32,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 78986d5c >2013-12-04 06:54:32,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3e5b51f3 >2013-12-04 06:54:32,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9af35b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1565aee2}, log id: 3e5b51f3 >2013-12-04 06:54:37,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2bdd3ba3 >2013-12-04 06:54:38,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bdd3ba3 >2013-12-04 06:54:38,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d9e7d1f >2013-12-04 06:54:38,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68f5b968, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c61c309f}, log id: 5d9e7d1f >2013-12-04 06:54:43,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 536323d8 >2013-12-04 06:54:43,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 536323d8 >2013-12-04 06:54:43,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3165ad4f >2013-12-04 06:54:44,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0f15b7e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f10c1fd2}, log id: 3165ad4f >2013-12-04 06:54:49,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1aef34c7 >2013-12-04 06:54:49,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1aef34c7 >2013-12-04 06:54:49,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 27a9c380 >2013-12-04 06:54:49,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7133e4d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd339831}, log id: 27a9c380 >2013-12-04 06:54:54,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12530736 >2013-12-04 06:54:55,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 12530736 >2013-12-04 06:54:55,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 254d0d4d >2013-12-04 06:54:55,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d3a9d3b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3f18632}, log id: 254d0d4d >2013-12-04 06:55:00,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 179592df >2013-12-04 06:55:01,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 179592df >2013-12-04 06:55:01,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 210ff630 >2013-12-04 06:55:01,330 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-04 06:55:01,331 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:55:01,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 75170454 >2013-12-04 06:55:01,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1652416, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48108da3}, log id: 210ff630 >2013-12-04 06:55:01,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 75170454 >2013-12-04 06:55:06,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 28b6f25f >2013-12-04 06:55:07,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 28b6f25f >2013-12-04 06:55:07,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61c9c8cb >2013-12-04 06:55:07,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1272a467, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2401fc7}, log id: 61c9c8cb >2013-12-04 06:55:12,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 60b76620 >2013-12-04 06:55:12,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 60b76620 >2013-12-04 06:55:12,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 37b4547b >2013-12-04 06:55:13,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bad6c0ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb6e6736}, log id: 37b4547b >2013-12-04 06:55:18,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 72e4e039 >2013-12-04 06:55:18,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72e4e039 >2013-12-04 06:55:18,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3641451a >2013-12-04 06:55:19,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fe56215, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7328791}, log id: 3641451a >2013-12-04 06:55:24,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2243c192 >2013-12-04 06:55:24,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2243c192 >2013-12-04 06:55:24,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 277f0ec0 >2013-12-04 06:55:24,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fde79e7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@517c5a2f}, log id: 277f0ec0 >2013-12-04 06:55:29,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 189f5ac >2013-12-04 06:55:30,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 189f5ac >2013-12-04 06:55:30,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5ecc7771 >2013-12-04 06:55:30,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14a8202a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1137641e}, log id: 5ecc7771 >2013-12-04 06:55:35,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5bc7060c >2013-12-04 06:55:36,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5bc7060c >2013-12-04 06:55:36,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 582fc77 >2013-12-04 06:55:36,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c64fae15, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6581c517}, log id: 582fc77 >2013-12-04 06:55:41,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4ea7bd1c >2013-12-04 06:55:42,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ea7bd1c >2013-12-04 06:55:42,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4c1d37e2 >2013-12-04 06:55:42,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2ac9417, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10692756}, log id: 4c1d37e2 >2013-12-04 06:55:47,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c3edcb0 >2013-12-04 06:55:47,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c3edcb0 >2013-12-04 06:55:47,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7af3919d >2013-12-04 06:55:48,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed8b6e58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a63fb02}, log id: 7af3919d >2013-12-04 06:55:53,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 696c5159 >2013-12-04 06:55:53,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 696c5159 >2013-12-04 06:55:53,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1e0497a3 >2013-12-04 06:55:53,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30d5773f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7aa894d}, log id: 1e0497a3 >2013-12-04 06:55:58,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6e30cf78 >2013-12-04 06:55:59,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e30cf78 >2013-12-04 06:55:59,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ce0668b >2013-12-04 06:55:59,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98e4aeec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99dc6138}, log id: 6ce0668b >2013-12-04 06:56:01,625 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) No up server in cluster >2013-12-04 06:56:01,625 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:56:01,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4535d990 >2013-12-04 06:56:01,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4535d990 >2013-12-04 06:56:04,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3916fbb9 >2013-12-04 06:56:05,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3916fbb9 >2013-12-04 06:56:05,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7215a4e6 >2013-12-04 06:56:05,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8e4f92b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ad0577c}, log id: 7215a4e6 >2013-12-04 06:56:10,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 49fff297 >2013-12-04 06:56:11,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 49fff297 >2013-12-04 06:56:11,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5084a292 >2013-12-04 06:56:11,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@caa208a4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a88b15}, log id: 5084a292 >2013-12-04 06:56:16,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7b3acd72 >2013-12-04 06:56:16,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b3acd72 >2013-12-04 06:56:16,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 658e668a >2013-12-04 06:56:17,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9055794c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb06f3e5}, log id: 658e668a >2013-12-04 06:56:22,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3cfdc6ef >2013-12-04 06:56:22,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3cfdc6ef >2013-12-04 06:56:22,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 75bb87dc >2013-12-04 06:56:23,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6263129c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82b45848}, log id: 75bb87dc >2013-12-04 06:56:28,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d64bd6f >2013-12-04 06:56:28,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1d64bd6f >2013-12-04 06:56:28,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 659940bf >2013-12-04 06:56:28,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cebcad17, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75b5b68d}, log id: 659940bf >2013-12-04 06:56:33,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 908d80d >2013-12-04 06:56:34,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 908d80d >2013-12-04 06:56:34,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1b9b3145 >2013-12-04 06:56:34,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1397d43, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@437f778}, log id: 1b9b3145 >2013-12-04 06:56:39,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f6110d2 >2013-12-04 06:56:40,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f6110d2 >2013-12-04 06:56:40,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 317fe475 >2013-12-04 06:56:40,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3ed196d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fbf51d8}, log id: 317fe475 >2013-12-04 06:56:45,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 621a5238 >2013-12-04 06:56:46,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 621a5238 >2013-12-04 06:56:46,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 424c313a >2013-12-04 06:56:46,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2c080f0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2005c8df}, log id: 424c313a >2013-12-04 06:56:51,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 130d03a6 >2013-12-04 06:56:51,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 130d03a6 >2013-12-04 06:56:51,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 48aff4ad >2013-12-04 06:56:52,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b7eb0f6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8ee91ff}, log id: 48aff4ad >2013-12-04 06:56:57,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4cdf843f >2013-12-04 06:56:57,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4cdf843f >2013-12-04 06:56:57,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 55ed3321 >2013-12-04 06:56:57,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5247211a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2480ec45}, log id: 55ed3321 >2013-12-04 06:57:01,944 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) No up server in cluster >2013-12-04 06:57:01,944 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:57:01,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 13b3257c >2013-12-04 06:57:02,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterTasksListVDSCommand, return: [], log id: 13b3257c >2013-12-04 06:57:02,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d028a6e >2013-12-04 06:57:03,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d028a6e >2013-12-04 06:57:03,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 24a6ae5d >2013-12-04 06:57:03,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@583680e7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11d49558}, log id: 24a6ae5d >2013-12-04 06:57:08,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 64807290 >2013-12-04 06:57:09,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 64807290 >2013-12-04 06:57:09,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6fffca7 >2013-12-04 06:57:09,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5cfe484, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac43db9b}, log id: 6fffca7 >2013-12-04 06:57:14,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 178f40b2 >2013-12-04 06:57:15,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 178f40b2 >2013-12-04 06:57:15,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e66511b >2013-12-04 06:57:15,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c28a9cb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99bd54d4}, log id: 4e66511b >2013-12-04 06:57:20,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2b1f0538 >2013-12-04 06:57:20,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b1f0538 >2013-12-04 06:57:20,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 37a3c4f4 >2013-12-04 06:57:21,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f38f2bd5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd7edb1f}, log id: 37a3c4f4 >2013-12-04 06:57:26,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6eb8baea >2013-12-04 06:57:26,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6eb8baea >2013-12-04 06:57:26,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6eb1e2c8 >2013-12-04 06:57:26,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43b05c97, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1949a8c3}, log id: 6eb1e2c8 >2013-12-04 06:57:32,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a823cd6 >2013-12-04 06:57:32,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a823cd6 >2013-12-04 06:57:32,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35c6cf48 >2013-12-04 06:57:32,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7a31155, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83ee491b}, log id: 35c6cf48 >2013-12-04 06:57:37,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 42f00c34 >2013-12-04 06:57:38,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 42f00c34 >2013-12-04 06:57:38,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c986638 >2013-12-04 06:57:38,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1b9968a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a9241f7}, log id: 6c986638 >2013-12-04 06:57:43,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d6522fe >2013-12-04 06:57:44,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d6522fe >2013-12-04 06:57:44,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 51e20268 >2013-12-04 06:57:44,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4f7b784, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@750da9f2}, log id: 51e20268 >2013-12-04 06:57:49,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: e40b770 >2013-12-04 06:57:49,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: e40b770 >2013-12-04 06:57:49,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 44400eb1 >2013-12-04 06:57:50,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7db3e98, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3914c767}, log id: 44400eb1 >2013-12-04 06:57:55,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 91c151a >2013-12-04 06:57:55,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 91c151a >2013-12-04 06:57:55,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 985f04a >2013-12-04 06:57:56,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a545d87, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c896c300}, log id: 985f04a >2013-12-04 06:58:01,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 538e2a28 >2013-12-04 06:58:01,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 538e2a28 >2013-12-04 06:58:01,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5d7cb087 >2013-12-04 06:58:01,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b787c6eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f3d0a94}, log id: 5d7cb087 >2013-12-04 06:58:02,258 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-04 06:58:02,258 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:58:02,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 112851ff >2013-12-04 06:58:02,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: 112851ff >2013-12-04 06:58:06,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1fd674cf >2013-12-04 06:58:07,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1fd674cf >2013-12-04 06:58:07,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 389f26b4 >2013-12-04 06:58:07,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b31e7750, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58f0b53e}, log id: 389f26b4 >2013-12-04 06:58:12,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ecd6809 >2013-12-04 06:58:13,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5ecd6809 >2013-12-04 06:58:13,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1577d9da >2013-12-04 06:58:13,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ede28bc9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4738515a}, log id: 1577d9da >2013-12-04 06:58:18,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: e910613 >2013-12-04 06:58:19,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: e910613 >2013-12-04 06:58:19,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2fea37d6 >2013-12-04 06:58:19,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91e76a44, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78b9ad7e}, log id: 2fea37d6 >2013-12-04 06:58:24,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: d4e44e3 >2013-12-04 06:58:25,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: d4e44e3 >2013-12-04 06:58:25,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7504d8ef >2013-12-04 06:58:25,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff2f9408, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b9f4b82}, log id: 7504d8ef >2013-12-04 06:58:30,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 368f2a47 >2013-12-04 06:58:30,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 368f2a47 >2013-12-04 06:58:30,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4f3ca946 >2013-12-04 06:58:31,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8458307, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59d4b6eb}, log id: 4f3ca946 >2013-12-04 06:58:36,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69bb2cf1 >2013-12-04 06:58:36,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 69bb2cf1 >2013-12-04 06:58:36,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: dfab31b >2013-12-04 06:58:36,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@696c4dcf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77566ec9}, log id: dfab31b >2013-12-04 06:58:41,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 423e491b >2013-12-04 06:58:42,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 423e491b >2013-12-04 06:58:42,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4db3b82d >2013-12-04 06:58:42,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b620c0e6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c4d7091}, log id: 4db3b82d >2013-12-04 06:58:47,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 355ef773 >2013-12-04 06:58:48,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 355ef773 >2013-12-04 06:58:48,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 672b526d >2013-12-04 06:58:48,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e78ae53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bac42b5d}, log id: 672b526d >2013-12-04 06:58:53,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b5e508d >2013-12-04 06:58:54,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b5e508d >2013-12-04 06:58:54,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 534bf172 >2013-12-04 06:58:54,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a45afa46, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f96e6b0b}, log id: 534bf172 >2013-12-04 06:58:59,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c981adb >2013-12-04 06:58:59,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2c981adb >2013-12-04 06:58:59,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 76ad750d >2013-12-04 06:59:00,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc062541, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f8d2e32}, log id: 76ad750d >2013-12-04 06:59:02,562 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] No up server in cluster >2013-12-04 06:59:02,562 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 06:59:02,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 38a0a8ef >2013-12-04 06:59:02,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterTasksListVDSCommand, return: [], log id: 38a0a8ef >2013-12-04 06:59:05,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74e36578 >2013-12-04 06:59:05,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 74e36578 >2013-12-04 06:59:05,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 578dd45a >2013-12-04 06:59:05,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19271bbb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@673488d}, log id: 578dd45a >2013-12-04 06:59:10,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c09bcb7 >2013-12-04 06:59:11,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6c09bcb7 >2013-12-04 06:59:11,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1bb91dd8 >2013-12-04 06:59:11,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99587ba0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74c11453}, log id: 1bb91dd8 >2013-12-04 06:59:13,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2188192b >2013-12-04 06:59:13,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@c0c73e9, log id: 2188192b >2013-12-04 06:59:13,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 58dcc2d >2013-12-04 06:59:13,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6c52dfbe, log id: 58dcc2d >2013-12-04 06:59:16,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 66837f76 >2013-12-04 06:59:17,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66837f76 >2013-12-04 06:59:17,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 9599a61 >2013-12-04 06:59:17,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17f449ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c96e128}, log id: 9599a61 >2013-12-04 06:59:22,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 117af4a9 >2013-12-04 06:59:23,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 117af4a9 >2013-12-04 06:59:23,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 261e6c8 >2013-12-04 06:59:23,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29d21ff0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab5eab61}, log id: 261e6c8 >2013-12-04 06:59:28,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4e860fcc >2013-12-04 06:59:28,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4e860fcc >2013-12-04 06:59:28,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 8792a63 >2013-12-04 06:59:29,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76e1e2bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcab094}, log id: 8792a63 >2013-12-04 06:59:34,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 73f2393 >2013-12-04 06:59:34,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 73f2393 >2013-12-04 06:59:34,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 46ad0080 >2013-12-04 06:59:35,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@153b005e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33c6992d}, log id: 46ad0080 >2013-12-04 06:59:40,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b3d0025 >2013-12-04 06:59:40,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b3d0025 >2013-12-04 06:59:40,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a0450d0 >2013-12-04 06:59:40,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86e22cfe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87ff153b}, log id: 6a0450d0 >2013-12-04 06:59:45,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c1ace82 >2013-12-04 06:59:46,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6c1ace82 >2013-12-04 06:59:46,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 62f1531c >2013-12-04 06:59:46,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@290dafcc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e380b012}, log id: 62f1531c >2013-12-04 06:59:51,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 109cbbba >2013-12-04 06:59:52,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 109cbbba >2013-12-04 06:59:52,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 879b98b >2013-12-04 06:59:52,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce6cd2df, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e7dab25}, log id: 879b98b >2013-12-04 06:59:57,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 360480f6 >2013-12-04 06:59:58,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 360480f6 >2013-12-04 06:59:58,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41fb669d >2013-12-04 06:59:58,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@222b5813, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e814e3d}, log id: 41fb669d >2013-12-04 07:00:02,890 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-04 07:00:02,891 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:00:02,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 32144639 >2013-12-04 07:00:03,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 32144639 >2013-12-04 07:00:03,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2da869f9 >2013-12-04 07:00:03,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2da869f9 >2013-12-04 07:00:03,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6f06a25b >2013-12-04 07:00:04,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bc172b1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@442d7870}, log id: 6f06a25b >2013-12-04 07:00:09,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 42597a65 >2013-12-04 07:00:09,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 42597a65 >2013-12-04 07:00:09,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35a4720 >2013-12-04 07:00:10,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fa66573, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ea2c766}, log id: 35a4720 >2013-12-04 07:00:15,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ea581a2 >2013-12-04 07:00:15,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ea581a2 >2013-12-04 07:00:15,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b95c8ff >2013-12-04 07:00:15,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a332dbf6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da5816ab}, log id: 3b95c8ff >2013-12-04 07:00:20,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6fceeeb2 >2013-12-04 07:00:21,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 6fceeeb2 >2013-12-04 07:00:21,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41119a4c >2013-12-04 07:00:21,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffd8715c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7d992}, log id: 41119a4c >2013-12-04 07:00:26,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: e3b0510 >2013-12-04 07:00:27,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e3b0510 >2013-12-04 07:00:27,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5a0f0834 >2013-12-04 07:00:27,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42209fe4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77e10639}, log id: 5a0f0834 >2013-12-04 07:00:32,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10d63580 >2013-12-04 07:00:33,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 10d63580 >2013-12-04 07:00:33,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43585793 >2013-12-04 07:00:33,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f91d6f2e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87be37c2}, log id: 43585793 >2013-12-04 07:00:38,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 65d106e >2013-12-04 07:00:38,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 65d106e >2013-12-04 07:00:38,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5bc8557 >2013-12-04 07:00:39,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b615f554, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bf3edb2}, log id: 5bc8557 >2013-12-04 07:00:44,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7041362 >2013-12-04 07:00:44,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7041362 >2013-12-04 07:00:44,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 440a4c06 >2013-12-04 07:00:45,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9710ee74, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1b1fae8}, log id: 440a4c06 >2013-12-04 07:00:50,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b817327 >2013-12-04 07:00:50,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b817327 >2013-12-04 07:00:50,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: c810fb0 >2013-12-04 07:00:50,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d4bf66c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50b0c9a7}, log id: c810fb0 >2013-12-04 07:00:55,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 117c784c >2013-12-04 07:00:56,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 117c784c >2013-12-04 07:00:56,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3829941b >2013-12-04 07:00:57,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7512fb4f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f53d210e}, log id: 3829941b >2013-12-04 07:01:02,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4df2c106 >2013-12-04 07:01:02,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4df2c106 >2013-12-04 07:01:02,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2d8a4c7a >2013-12-04 07:01:02,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@406bbe20, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da547014}, log id: 2d8a4c7a >2013-12-04 07:01:03,205 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) No up server in cluster >2013-12-04 07:01:03,205 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:01:03,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 537ae630 >2013-12-04 07:01:03,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, return: [], log id: 537ae630 >2013-12-04 07:01:07,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 66bcd01c >2013-12-04 07:01:08,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 66bcd01c >2013-12-04 07:01:08,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 72824a94 >2013-12-04 07:01:08,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29f71fd0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f8ee742}, log id: 72824a94 >2013-12-04 07:01:13,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 171ec7d4 >2013-12-04 07:01:14,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 171ec7d4 >2013-12-04 07:01:14,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 77aa98da >2013-12-04 07:01:14,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef3fdae6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea94b244}, log id: 77aa98da >2013-12-04 07:01:19,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42440ac >2013-12-04 07:01:20,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 42440ac >2013-12-04 07:01:20,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 65db5933 >2013-12-04 07:01:20,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25f64f2c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7355581}, log id: 65db5933 >2013-12-04 07:01:25,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c866d7f >2013-12-04 07:01:25,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5c866d7f >2013-12-04 07:01:25,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 62a63f0a >2013-12-04 07:01:26,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69bfc432, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb676de}, log id: 62a63f0a >2013-12-04 07:01:31,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 64d0a775 >2013-12-04 07:01:31,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 64d0a775 >2013-12-04 07:01:31,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4da817f >2013-12-04 07:01:32,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b43b5fd6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5875d163}, log id: 4da817f >2013-12-04 07:01:37,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 10d1832 >2013-12-04 07:01:37,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10d1832 >2013-12-04 07:01:37,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: a94e8c3 >2013-12-04 07:01:38,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba04f2f0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c18237a5}, log id: a94e8c3 >2013-12-04 07:01:43,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5681eece >2013-12-04 07:01:43,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5681eece >2013-12-04 07:01:43,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 404ab95 >2013-12-04 07:01:43,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30881997, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e28100a0}, log id: 404ab95 >2013-12-04 07:01:48,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5d2598ee >2013-12-04 07:01:49,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d2598ee >2013-12-04 07:01:49,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3955a3ea >2013-12-04 07:01:49,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebb5cfe7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65f5b56}, log id: 3955a3ea >2013-12-04 07:01:54,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 86b4e95 >2013-12-04 07:01:55,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 86b4e95 >2013-12-04 07:01:55,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5bd1c4d1 >2013-12-04 07:01:55,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfac3850, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6846cf72}, log id: 5bd1c4d1 >2013-12-04 07:02:00,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7d39d6df >2013-12-04 07:02:01,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d39d6df >2013-12-04 07:02:01,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3a2d8e69 >2013-12-04 07:02:01,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5bf2c85, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bab7161}, log id: 3a2d8e69 >2013-12-04 07:02:03,525 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-04 07:02:03,525 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:02:03,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e449b5b >2013-12-04 07:02:03,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2e449b5b >2013-12-04 07:02:06,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48a4bcdf >2013-12-04 07:02:06,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 48a4bcdf >2013-12-04 07:02:06,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 532e0663 >2013-12-04 07:02:07,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bebb1858, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ed64da2}, log id: 532e0663 >2013-12-04 07:02:12,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d5daa30 >2013-12-04 07:02:12,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d5daa30 >2013-12-04 07:02:12,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78d42e9b >2013-12-04 07:02:13,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a00c7a7e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@678ed07b}, log id: 78d42e9b >2013-12-04 07:02:18,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f49458e >2013-12-04 07:02:18,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: f49458e >2013-12-04 07:02:18,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ad3153e >2013-12-04 07:02:18,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1317f8c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82d2afdd}, log id: 2ad3153e >2013-12-04 07:02:23,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6cb7d0c7 >2013-12-04 07:02:24,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cb7d0c7 >2013-12-04 07:02:24,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 424f5f2d >2013-12-04 07:02:24,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4efc72e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cddf070f}, log id: 424f5f2d >2013-12-04 07:02:29,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 55d90413 >2013-12-04 07:02:30,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 55d90413 >2013-12-04 07:02:30,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4bc7f728 >2013-12-04 07:02:30,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c8fc179, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c8fac45}, log id: 4bc7f728 >2013-12-04 07:02:35,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7cef1142 >2013-12-04 07:02:36,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7cef1142 >2013-12-04 07:02:36,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20cb1235 >2013-12-04 07:02:36,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b10af5b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7005748}, log id: 20cb1235 >2013-12-04 07:02:41,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 129f6e42 >2013-12-04 07:02:41,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 129f6e42 >2013-12-04 07:02:41,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 9c899cd >2013-12-04 07:02:42,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa23e0a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2d1982b}, log id: 9c899cd >2013-12-04 07:02:47,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 435813cb >2013-12-04 07:02:47,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 435813cb >2013-12-04 07:02:47,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d7ca50f >2013-12-04 07:02:47,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c9dda93, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d009df9}, log id: 2d7ca50f >2013-12-04 07:02:53,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5949e0f2 >2013-12-04 07:02:53,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 5949e0f2 >2013-12-04 07:02:53,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4df6643e >2013-12-04 07:02:53,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98cf2c73, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@989e717a}, log id: 4df6643e >2013-12-04 07:02:58,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2fd839d5 >2013-12-04 07:02:59,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fd839d5 >2013-12-04 07:02:59,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b1d2bd2 >2013-12-04 07:02:59,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee47843b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41dab48a}, log id: 3b1d2bd2 >2013-12-04 07:03:03,847 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-04 07:03:03,847 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:03:03,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 66d0c3a8 >2013-12-04 07:03:04,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 66d0c3a8 >2013-12-04 07:03:04,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b1931ff >2013-12-04 07:03:05,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: b1931ff >2013-12-04 07:03:05,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 290de285 >2013-12-04 07:03:05,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78c95181, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17002671}, log id: 290de285 >2013-12-04 07:03:10,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20eab3dc >2013-12-04 07:03:10,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 20eab3dc >2013-12-04 07:03:11,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5899b848 >2013-12-04 07:03:11,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfcfea20, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10351bc}, log id: 5899b848 >2013-12-04 07:03:16,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4759554d >2013-12-04 07:03:16,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4759554d >2013-12-04 07:03:16,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5baf934d >2013-12-04 07:03:17,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da9d082c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb053d17}, log id: 5baf934d >2013-12-04 07:03:22,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 724b722f >2013-12-04 07:03:22,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 724b722f >2013-12-04 07:03:22,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5838c36b >2013-12-04 07:03:22,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10b01ab8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@187f8779}, log id: 5838c36b >2013-12-04 07:03:27,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d750e2e >2013-12-04 07:03:28,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4d750e2e >2013-12-04 07:03:28,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 555fdf75 >2013-12-04 07:03:28,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40115cab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c2a5449}, log id: 555fdf75 >2013-12-04 07:03:33,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3a741634 >2013-12-04 07:03:34,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3a741634 >2013-12-04 07:03:34,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36fbdfb6 >2013-12-04 07:03:34,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2fd6815, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf1ca0e6}, log id: 36fbdfb6 >2013-12-04 07:03:39,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b943a93 >2013-12-04 07:03:40,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 4b943a93 >2013-12-04 07:03:40,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 624d8b7a >2013-12-04 07:03:40,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d5955d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1df18014}, log id: 624d8b7a >2013-12-04 07:03:45,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7805999e >2013-12-04 07:03:45,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 7805999e >2013-12-04 07:03:45,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: aae398a >2013-12-04 07:03:46,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8efc362, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c437bad}, log id: aae398a >2013-12-04 07:03:51,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4bdbdaaf >2013-12-04 07:03:51,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bdbdaaf >2013-12-04 07:03:51,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 78e9bd84 >2013-12-04 07:03:52,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50a4e4da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21f3a492}, log id: 78e9bd84 >2013-12-04 07:03:57,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 8eb0b26 >2013-12-04 07:03:57,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 8eb0b26 >2013-12-04 07:03:57,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 793f170a >2013-12-04 07:03:57,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4abad3ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99543084}, log id: 793f170a >2013-12-04 07:04:03,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d75d38 >2013-12-04 07:04:03,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2d75d38 >2013-12-04 07:04:03,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 251416fd >2013-12-04 07:04:03,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16922a6a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c94d0bd3}, log id: 251416fd >2013-12-04 07:04:04,150 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) No up server in cluster >2013-12-04 07:04:04,151 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:04:04,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 72ba6db5 >2013-12-04 07:04:04,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, return: [], log id: 72ba6db5 >2013-12-04 07:04:08,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54c1805b >2013-12-04 07:04:09,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 54c1805b >2013-12-04 07:04:09,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 75510eef >2013-12-04 07:04:09,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a8fc0c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@210aae16}, log id: 75510eef >2013-12-04 07:04:13,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6e0c3017 >2013-12-04 07:04:14,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1307b0c3, log id: 6e0c3017 >2013-12-04 07:04:14,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5de5dbf7 >2013-12-04 07:04:14,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@551d2140, log id: 5de5dbf7 >2013-12-04 07:04:14,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6a8ead90 >2013-12-04 07:04:15,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a8ead90 >2013-12-04 07:04:15,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1676d77f >2013-12-04 07:04:15,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f75eb77, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d75fb953}, log id: 1676d77f >2013-12-04 07:04:20,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5feb5739 >2013-12-04 07:04:21,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5feb5739 >2013-12-04 07:04:21,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 64699234 >2013-12-04 07:04:21,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df4c138d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc1d9cc9}, log id: 64699234 >2013-12-04 07:04:26,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6733e0f9 >2013-12-04 07:04:26,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6733e0f9 >2013-12-04 07:04:26,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 26ac56d4 >2013-12-04 07:04:27,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24c3ec74, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a6ff4f3}, log id: 26ac56d4 >2013-12-04 07:04:32,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 49eaa2aa >2013-12-04 07:04:32,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49eaa2aa >2013-12-04 07:04:32,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 6ff86189 >2013-12-04 07:04:32,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ce44157, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25b51128}, log id: 6ff86189 >2013-12-04 07:04:37,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 11cbb17b >2013-12-04 07:04:38,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11cbb17b >2013-12-04 07:04:38,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 378ffe7f >2013-12-04 07:04:38,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@823a8a8e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbbcabfc}, log id: 378ffe7f >2013-12-04 07:04:43,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27a95f0f >2013-12-04 07:04:44,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 27a95f0f >2013-12-04 07:04:44,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2879d298 >2013-12-04 07:04:44,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38bbc2da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adc3fa02}, log id: 2879d298 >2013-12-04 07:04:49,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2fc80dea >2013-12-04 07:04:50,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fc80dea >2013-12-04 07:04:50,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4433e32c >2013-12-04 07:04:50,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@191c624c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcd3498}, log id: 4433e32c >2013-12-04 07:04:55,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5b55bab8 >2013-12-04 07:04:55,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b55bab8 >2013-12-04 07:04:55,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 575360a5 >2013-12-04 07:04:56,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3d4708f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e10da6d}, log id: 575360a5 >2013-12-04 07:05:01,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69703d84 >2013-12-04 07:05:01,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 69703d84 >2013-12-04 07:05:01,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34571262 >2013-12-04 07:05:02,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2e71722, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e78347c8}, log id: 34571262 >2013-12-04 07:05:04,468 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-04 07:05:04,468 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:05:04,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39e3e17 >2013-12-04 07:05:04,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 39e3e17 >2013-12-04 07:05:07,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5cd33b8 >2013-12-04 07:05:07,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5cd33b8 >2013-12-04 07:05:07,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 85476a3 >2013-12-04 07:05:07,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbae1d36, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47978a49}, log id: 85476a3 >2013-12-04 07:05:12,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7fd47ef0 >2013-12-04 07:05:13,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fd47ef0 >2013-12-04 07:05:13,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 551c47a0 >2013-12-04 07:05:13,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@317ad5e3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f8aa378}, log id: 551c47a0 >2013-12-04 07:05:18,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4e6b1601 >2013-12-04 07:05:19,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e6b1601 >2013-12-04 07:05:19,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e0e94c5 >2013-12-04 07:05:19,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cf486b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f405599}, log id: 5e0e94c5 >2013-12-04 07:05:24,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ea90031 >2013-12-04 07:05:25,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: ea90031 >2013-12-04 07:05:25,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c8dc749 >2013-12-04 07:05:25,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bbf099f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d536ecd}, log id: c8dc749 >2013-12-04 07:05:30,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17ae1b7 >2013-12-04 07:05:30,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 17ae1b7 >2013-12-04 07:05:30,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 16212f5f >2013-12-04 07:05:31,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@342c34ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@356ab032}, log id: 16212f5f >2013-12-04 07:05:36,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f33c9c4 >2013-12-04 07:05:36,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3f33c9c4 >2013-12-04 07:05:36,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10789695 >2013-12-04 07:05:36,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db714cb2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6632a872}, log id: 10789695 >2013-12-04 07:05:42,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6430e849 >2013-12-04 07:05:42,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6430e849 >2013-12-04 07:05:42,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ac21c5e >2013-12-04 07:05:43,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d05dc60, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ec2df53}, log id: 7ac21c5e >2013-12-04 07:05:48,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2e004b14 >2013-12-04 07:05:48,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e004b14 >2013-12-04 07:05:48,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 561f42f0 >2013-12-04 07:05:48,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3fa08dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92775c2d}, log id: 561f42f0 >2013-12-04 07:05:53,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4151fa01 >2013-12-04 07:05:54,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4151fa01 >2013-12-04 07:05:54,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30c6a0d3 >2013-12-04 07:05:54,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9748a20d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0514639}, log id: 30c6a0d3 >2013-12-04 07:05:59,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1f23cacb >2013-12-04 07:06:00,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 1f23cacb >2013-12-04 07:06:00,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3fc723c9 >2013-12-04 07:06:00,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be397495, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ca2fcbf}, log id: 3fc723c9 >2013-12-04 07:06:04,779 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-04 07:06:04,779 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:06:04,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 43cfd314 >2013-12-04 07:06:05,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: 43cfd314 >2013-12-04 07:06:05,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41cc3fa6 >2013-12-04 07:06:06,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 41cc3fa6 >2013-12-04 07:06:06,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 770b1fff >2013-12-04 07:06:06,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e77fe8f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d1a75fe}, log id: 770b1fff >2013-12-04 07:06:11,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6000f673 >2013-12-04 07:06:11,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6000f673 >2013-12-04 07:06:11,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e9c8f8e >2013-12-04 07:06:12,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15fdfc79, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66a97e00}, log id: 1e9c8f8e >2013-12-04 07:06:17,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3ed24974 >2013-12-04 07:06:17,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ed24974 >2013-12-04 07:06:17,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 73a8565e >2013-12-04 07:06:18,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e150a38, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52822a03}, log id: 73a8565e >2013-12-04 07:06:23,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 2220b917 >2013-12-04 07:06:23,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2220b917 >2013-12-04 07:06:23,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 590ab87e >2013-12-04 07:06:23,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bafa14b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ae6c92e}, log id: 590ab87e >2013-12-04 07:06:28,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 110df9ee >2013-12-04 07:06:29,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 110df9ee >2013-12-04 07:06:29,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3609ab4a >2013-12-04 07:06:29,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86821afd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bd06c3e}, log id: 3609ab4a >2013-12-04 07:06:34,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7d7567d5 >2013-12-04 07:06:35,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d7567d5 >2013-12-04 07:06:35,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: fe654d8 >2013-12-04 07:06:35,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e86107b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2be4868e}, log id: fe654d8 >2013-12-04 07:06:40,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 459e3fdf >2013-12-04 07:06:40,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 459e3fdf >2013-12-04 07:06:40,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 57efe89b >2013-12-04 07:06:41,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f9bbef0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a625c8b}, log id: 57efe89b >2013-12-04 07:06:46,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 75b37525 >2013-12-04 07:06:46,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 75b37525 >2013-12-04 07:06:46,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17328141 >2013-12-04 07:06:47,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5325d9d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@964441f4}, log id: 17328141 >2013-12-04 07:06:52,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 201f0bb5 >2013-12-04 07:06:52,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 201f0bb5 >2013-12-04 07:06:52,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d1b77fc >2013-12-04 07:06:52,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47dd06a5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a150453a}, log id: 3d1b77fc >2013-12-04 07:06:57,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: bf0f9e6 >2013-12-04 07:06:58,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: bf0f9e6 >2013-12-04 07:06:58,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7dbb9e53 >2013-12-04 07:06:58,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a36dbe54, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40ffeb33}, log id: 7dbb9e53 >2013-12-04 07:07:03,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c2f3a0f >2013-12-04 07:07:04,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c2f3a0f >2013-12-04 07:07:04,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d281b58 >2013-12-04 07:07:04,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8872cc4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94d7b800}, log id: 2d281b58 >2013-12-04 07:07:05,096 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-04 07:07:05,096 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:07:05,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 659a75ca >2013-12-04 07:07:05,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: 659a75ca >2013-12-04 07:07:09,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53f61c23 >2013-12-04 07:07:10,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 53f61c23 >2013-12-04 07:07:10,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a0ce347 >2013-12-04 07:07:10,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70ea9f80, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a480ad78}, log id: 7a0ce347 >2013-12-04 07:07:15,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d46d7a1 >2013-12-04 07:07:16,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: d46d7a1 >2013-12-04 07:07:16,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f584daf >2013-12-04 07:07:16,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffa06d7f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0715045}, log id: 1f584daf >2013-12-04 07:07:21,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4121f162 >2013-12-04 07:07:21,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4121f162 >2013-12-04 07:07:21,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3f86585c >2013-12-04 07:07:22,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d525ac03, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4d9c52b}, log id: 3f86585c >2013-12-04 07:07:27,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 37ee642d >2013-12-04 07:07:27,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37ee642d >2013-12-04 07:07:27,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 458a8af2 >2013-12-04 07:07:27,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee1c2f5d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ede235cd}, log id: 458a8af2 >2013-12-04 07:07:33,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 28e6b0c >2013-12-04 07:07:33,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 28e6b0c >2013-12-04 07:07:33,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5d818c3b >2013-12-04 07:07:33,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e68fcaa8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e031f8d0}, log id: 5d818c3b >2013-12-04 07:07:38,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b7393fe >2013-12-04 07:07:39,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b7393fe >2013-12-04 07:07:39,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 322d6b26 >2013-12-04 07:07:39,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59df228c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d71cb36e}, log id: 322d6b26 >2013-12-04 07:07:44,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 775844dc >2013-12-04 07:07:45,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 775844dc >2013-12-04 07:07:45,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 23bc4eb6 >2013-12-04 07:07:45,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d3431e4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ba95a7b}, log id: 23bc4eb6 >2013-12-04 07:07:50,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 390d9930 >2013-12-04 07:07:50,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 390d9930 >2013-12-04 07:07:50,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63ad5368 >2013-12-04 07:07:51,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29f9566a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@934428d3}, log id: 63ad5368 >2013-12-04 07:07:56,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1b0ac422 >2013-12-04 07:07:56,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b0ac422 >2013-12-04 07:07:56,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1176cc21 >2013-12-04 07:07:57,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c84c3961, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8751c057}, log id: 1176cc21 >2013-12-04 07:08:02,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14fc66c2 >2013-12-04 07:08:02,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 14fc66c2 >2013-12-04 07:08:02,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 492d6dab >2013-12-04 07:08:02,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@666ba94c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4787195}, log id: 492d6dab >2013-12-04 07:08:05,415 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) No up server in cluster >2013-12-04 07:08:05,415 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:08:05,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d61e2f6 >2013-12-04 07:08:05,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, return: [], log id: d61e2f6 >2013-12-04 07:08:07,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41836a76 >2013-12-04 07:08:08,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 41836a76 >2013-12-04 07:08:08,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ccd33da >2013-12-04 07:08:08,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e62d53af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8e1e33}, log id: 4ccd33da >2013-12-04 07:08:13,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55e45ec5 >2013-12-04 07:08:14,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 55e45ec5 >2013-12-04 07:08:14,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 15cbdbdd >2013-12-04 07:08:14,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dba82bcd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b754320a}, log id: 15cbdbdd >2013-12-04 07:08:19,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 707a9246 >2013-12-04 07:08:20,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 707a9246 >2013-12-04 07:08:20,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e822fc0 >2013-12-04 07:08:20,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66d2bbec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5866aa2a}, log id: 7e822fc0 >2013-12-04 07:08:25,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3160ee87 >2013-12-04 07:08:25,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 3160ee87 >2013-12-04 07:08:25,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 455a9a46 >2013-12-04 07:08:26,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e5c9764, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@294c80db}, log id: 455a9a46 >2013-12-04 07:08:31,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4e85e31a >2013-12-04 07:08:31,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4e85e31a >2013-12-04 07:08:31,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1bd4558a >2013-12-04 07:08:31,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbb7459d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2ee6987}, log id: 1bd4558a >2013-12-04 07:08:36,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 664cbf28 >2013-12-04 07:08:37,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 664cbf28 >2013-12-04 07:08:37,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 16d79de0 >2013-12-04 07:08:37,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4996599d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98800fe6}, log id: 16d79de0 >2013-12-04 07:08:38,239 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-3) [32a1e893] Running command: LogoutUserCommand internal: false. >2013-12-04 07:08:38,212 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-11) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:08:38,345 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [32a1e893] Correlation ID: 32a1e893, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2013-12-04 07:08:42,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 295b97d7 >2013-12-04 07:08:43,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 295b97d7 >2013-12-04 07:08:43,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 339796e6 >2013-12-04 07:08:43,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e0771f0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afbf08a3}, log id: 339796e6 >2013-12-04 07:08:48,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3711e7d5 >2013-12-04 07:08:49,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3711e7d5 >2013-12-04 07:08:49,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: ee00e8b >2013-12-04 07:08:49,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3666aec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff868fd}, log id: ee00e8b >2013-12-04 07:08:53,189 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-16) Running command: LoginAdminUserCommand internal: false. >2013-12-04 07:08:53,214 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-16) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2013-12-04 07:08:53,322 INFO [org.ovirt.engine.api.restapi.security.auth.LoginValidator] (ajp-/127.0.0.1:8702-13) Validating session failed, reason: Session does not exist. >2013-12-04 07:08:54,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 352c6a31 >2013-12-04 07:08:55,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 352c6a31 >2013-12-04 07:08:55,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 71e4d640 >2013-12-04 07:08:55,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d09d12ae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26cae825}, log id: 71e4d640 >2013-12-04 07:08:59,733 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-17) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:09:00,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1368d649 >2013-12-04 07:09:00,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1368d649 >2013-12-04 07:09:00,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 221f3154 >2013-12-04 07:09:01,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d441234, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd9b1709}, log id: 221f3154 >2013-12-04 07:09:05,724 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [54e92961] No up server in cluster >2013-12-04 07:09:05,725 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [54e92961] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:09:05,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 5a8a204e >2013-12-04 07:09:06,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5a8a204e >2013-12-04 07:09:06,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66b2c1b2 >2013-12-04 07:09:06,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 66b2c1b2 >2013-12-04 07:09:06,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71d4858 >2013-12-04 07:09:06,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8352c6fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@951fa33}, log id: 71d4858 >2013-12-04 07:09:11,945 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-8) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:09:12,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6149d4af >2013-12-04 07:09:12,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6149d4af >2013-12-04 07:09:12,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d3ea018 >2013-12-04 07:09:12,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ecc7ce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8faaa526}, log id: 2d3ea018 >2013-12-04 07:09:14,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: b7a1b11 >2013-12-04 07:09:14,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@9a831c1, log id: b7a1b11 >2013-12-04 07:09:14,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 15a7adb >2013-12-04 07:09:15,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6d60fc0c, log id: 15a7adb >2013-12-04 07:09:17,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1acfaa37 >2013-12-04 07:09:18,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1acfaa37 >2013-12-04 07:09:18,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c651553 >2013-12-04 07:09:18,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@659a0f89, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7c9e78a}, log id: 3c651553 >2013-12-04 07:09:23,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 445c642d >2013-12-04 07:09:24,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 445c642d >2013-12-04 07:09:24,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1e446584 >2013-12-04 07:09:24,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38c1884, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58d61582}, log id: 1e446584 >2013-12-04 07:09:29,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c2ecd2c >2013-12-04 07:09:29,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c2ecd2c >2013-12-04 07:09:29,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12ad7099 >2013-12-04 07:09:30,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53891406, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3cb05f5}, log id: 12ad7099 >2013-12-04 07:09:35,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7b8ecdd9 >2013-12-04 07:09:35,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b8ecdd9 >2013-12-04 07:09:35,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f88eed9 >2013-12-04 07:09:36,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f508c3b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34705af6}, log id: 1f88eed9 >2013-12-04 07:09:41,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21382395 >2013-12-04 07:09:41,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 21382395 >2013-12-04 07:09:41,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 58e51097 >2013-12-04 07:09:41,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d7029cc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@487a53c0}, log id: 58e51097 >2013-12-04 07:09:46,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69195858 >2013-12-04 07:09:47,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, log id: 69195858 >2013-12-04 07:09:47,200 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-29) Gluster servers list failed in server host1 moving it to NonOperational >2013-12-04 07:09:47,208 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-29) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to fetch gluster peer list from server host1 on Cluster test. >2013-12-04 07:09:47,244 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-29) [215fe8ee] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:09:47,252 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-29) [215fe8ee] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, status=NonOperational, nonOperationalReason=GLUSTER_COMMAND_FAILED), log id: 78f77388 >2013-12-04 07:09:47,256 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-29) [215fe8ee] FINISH, SetVdsStatusVDSCommand, log id: 78f77388 >2013-12-04 07:09:47,272 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-29) [215fe8ee] Correlation ID: 215fe8ee, Job ID: 08f710f4-9235-4b58-8c1e-d2166771e322, Call Stack: null, Custom Event ID: -1, Message: Gluster command [gluster peer status] failed on server host1. >2013-12-04 07:09:47,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [215fe8ee] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 566074d7 >2013-12-04 07:09:47,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [215fe8ee] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 566074d7 >2013-12-04 07:09:47,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [215fe8ee] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6b7611cd >2013-12-04 07:09:48,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [215fe8ee] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b7611cd >2013-12-04 07:09:48,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-29) [215fe8ee] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to fetch gluster volume list from server host1. >2013-12-04 07:09:48,132 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-29) [44971035] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:09:48,220 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-29) [44971035] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, status=NonOperational, nonOperationalReason=GLUSTER_COMMAND_FAILED), log id: 6b696e40 >2013-12-04 07:09:48,224 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-29) [44971035] FINISH, SetVdsStatusVDSCommand, log id: 6b696e40 >2013-12-04 07:09:48,283 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-29) [44971035] Correlation ID: 44971035, Job ID: 2e490cf5-9a75-4d74-be10-2791f24ce588, Call Stack: null, Custom Event ID: -1, Message: Gluster command [gluster peer status] failed on server host1. >2013-12-04 07:09:48,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [44971035] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e19677a >2013-12-04 07:09:48,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [44971035] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbd758bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1449de8d}, log id: 6e19677a >2013-12-04 07:09:51,031 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-2) [415e358a] Lock Acquired to object EngineLock [exclusiveLocks= key: be2c16f2-a173-4bac-a979-47cf211a97e3 value: GLUSTER >, sharedLocks= ] >2013-12-04 07:09:51,035 WARN [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-2) [415e358a] CanDoAction of action StartRemoveGlusterVolumeBricks failed. Reasons:$volumeName dis_vol,$vdsGroup test,VAR__ACTION__REMOVE_BRICKS_START,VAR__TYPE__GLUSTER_BRICK,ACTION_TYPE_FAILED_ONE_OR_MORE_BRICKS_ARE_DOWN >2013-12-04 07:09:51,036 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-2) [415e358a] Lock freed to object EngineLock [exclusiveLocks= key: be2c16f2-a173-4bac-a979-47cf211a97e3 value: GLUSTER >, sharedLocks= ] >2013-12-04 07:09:53,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4025aa48 >2013-12-04 07:09:54,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 4025aa48 >2013-12-04 07:09:54,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5283a6db >2013-12-04 07:09:54,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9e19d86, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f23ccbd3}, log id: 5283a6db >2013-12-04 07:09:59,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4eadf096 >2013-12-04 07:09:59,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4eadf096 >2013-12-04 07:09:59,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5265ab5f >2013-12-04 07:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-5) Autorecovering 1 hosts >2013-12-04 07:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-5) Autorecovering hosts id: 4c17e50e-8225-48c6-bcb3-bfba4ec37037, name : host1 >2013-12-04 07:10:00,019 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-5) [7a323326] Lock Acquired to object EngineLock [exclusiveLocks= key: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 value: VDS >, sharedLocks= ] >2013-12-04 07:10:00,039 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-5) [7a323326] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:10:00,039 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-5) [7a323326] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2013-12-04 07:10:00,039 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-5) [7a323326] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2013-12-04 07:10:00,059 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-5) [7a323326] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, status=Unassigned, nonOperationalReason=NONE), log id: 254276a >2013-12-04 07:10:00,062 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-5) [7a323326] FINISH, SetVdsStatusVDSCommand, log id: 254276a >2013-12-04 07:10:00,063 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-5) [7a323326] START, ActivateVdsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 75ef744 >2013-12-04 07:10:00,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) [7a323326] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, vds=Host[host1]), log id: 540288c >2013-12-04 07:10:00,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) [7a323326] FINISH, GetHardwareInfoVDSCommand, log id: 540288c >2013-12-04 07:10:00,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [7a323326] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2786c22f >2013-12-04 07:10:00,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@970d0b23, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b1c62b9}, log id: 5265ab5f >2013-12-04 07:10:05,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: af98e20 >2013-12-04 07:10:05,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: af98e20 >2013-12-04 07:10:05,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 69e384b >2013-12-04 07:10:05,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [7a323326] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 2786c22f >2013-12-04 07:10:05,933 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:10:05,934 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 75ef744 >2013-12-04 07:10:05,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3350e40a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e49588d}, log id: 69e384b >2013-12-04 07:10:06,041 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) No up server in cluster >2013-12-04 07:10:06,041 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:10:06,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 1ed63155 >2013-12-04 07:10:06,100 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2013-12-04 07:10:06,104 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] Lock freed to object EngineLock [exclusiveLocks= key: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 value: VDS >, sharedLocks= ] >2013-12-04 07:10:06,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1ed63155 >2013-12-04 07:10:07,140 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, vds=Host[host1]), log id: 5c02e18f >2013-12-04 07:10:07,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GetHardwareInfoVDSCommand, log id: 5c02e18f >2013-12-04 07:10:07,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 60ef9df0 >2013-12-04 07:10:07,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 60ef9df0 >2013-12-04 07:10:07,739 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-48) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host host1. >2013-12-04 07:10:07,759 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-48) [37989805] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 5849b030-626e-47cb-ad90-3ce782d831b3 Type: StoragePool >2013-12-04 07:10:07,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [37989805] START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 570e837 >2013-12-04 07:10:08,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [37989805] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 570e837 >2013-12-04 07:10:08,315 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:10:11,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 3e92f54f >2013-12-04 07:10:11,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e92f54f >2013-12-04 07:10:11,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 223e40d3 >2013-12-04 07:10:11,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df05248b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a73dd27d}, log id: 223e40d3 >2013-12-04 07:10:16,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 30f6a72c >2013-12-04 07:10:17,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED], log id: 30f6a72c >2013-12-04 07:10:17,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 746c95a6 >2013-12-04 07:10:17,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b07350d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc8b41e8}, log id: 746c95a6 >2013-12-04 07:10:21,805 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-17) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:10:22,130 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-8) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:10:22,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5feb6c1f >2013-12-04 07:10:23,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5feb6c1f >2013-12-04 07:10:23,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4446492f >2013-12-04 07:10:23,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30ce34bd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6318d0b6}, log id: 4446492f >2013-12-04 07:10:24,425 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-10) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:10:27,315 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-7) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:10:28,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 7a853a11 >2013-12-04 07:10:29,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a853a11 >2013-12-04 07:10:29,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 4c8fbf05 >2013-12-04 07:10:29,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e2a822c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7a1036c}, log id: 4c8fbf05 >2013-12-04 07:10:30,317 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-4-thread-14) [2ed75cd5] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 11c0004e-e860-44fa-adf3-9fa5e57b864c Type: VDS >2013-12-04 07:10:30,326 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-14) [2ed75cd5] START, SetVdsStatusVDSCommand(HostName = host4, HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 28b9402b >2013-12-04 07:10:30,329 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-14) [2ed75cd5] FINISH, SetVdsStatusVDSCommand, log id: 28b9402b >2013-12-04 07:10:30,357 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-4-thread-14) [2ed75cd5] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 11c0004e-e860-44fa-adf3-9fa5e57b864c Type: VDS >2013-12-04 07:10:30,364 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-14) [2ed75cd5] Correlation ID: 2ed75cd5, Job ID: 30c0fe7e-8562-4651-b30e-0a6f63df8d32, Call Stack: null, Custom Event ID: -1, Message: Host host4 was switched to Maintenance mode by admin@internal. >2013-12-04 07:10:32,048 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-36) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 11c0004e-e860-44fa-adf3-9fa5e57b864c : host4 >2013-12-04 07:10:32,152 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-4-thread-48) Clearing cache of pool: 5849b030-626e-47cb-ad90-3ce782d831b3 for problematic entities of VDS: host4. >2013-12-04 07:10:34,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7d2e8c17 >2013-12-04 07:10:34,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.147:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d2e8c17 >2013-12-04 07:10:34,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f10d4e3 >2013-12-04 07:10:35,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb65905, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d40bc31}, log id: 5f10d4e3 >2013-12-04 07:10:36,068 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-14) [79300b83] Lock Acquired to object EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 07:10:36,209 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-14) [79300b83] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 11c0004e-e860-44fa-adf3-9fa5e57b864c Type: VDS >2013-12-04 07:10:36,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.RemoveGlusterServerVDSCommand] (pool-4-thread-14) [79300b83] START, RemoveGlusterServerVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e3629c5 >2013-12-04 07:10:36,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.RemoveGlusterServerVDSCommand] (pool-4-thread-14) [79300b83] FINISH, RemoveGlusterServerVDSCommand, log id: 3e3629c5 >2013-12-04 07:10:36,767 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-14) [79300b83] START, RemoveVdsVDSCommand( HostId = 11c0004e-e860-44fa-adf3-9fa5e57b864c), log id: 784e5f11 >2013-12-04 07:10:36,767 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-4-thread-14) [79300b83] vdsManager::disposing >2013-12-04 07:10:36,777 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-4-thread-14) [79300b83] FINISH, RemoveVdsVDSCommand, log id: 784e5f11 >2013-12-04 07:10:36,783 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-14) [79300b83] Correlation ID: 79300b83, Call Stack: null, Custom Event ID: -1, Message: Host host4 was removed by admin@internal. >2013-12-04 07:10:36,783 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-4-thread-14) [79300b83] Lock freed to object EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 07:10:38,177 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-3) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:10:40,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 168118b6 >2013-12-04 07:10:40,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 168118b6 >2013-12-04 07:10:40,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 560f4d33 >2013-12-04 07:10:41,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83985d74, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c47d41e}, log id: 560f4d33 >2013-12-04 07:10:46,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c8c9dcd >2013-12-04 07:10:46,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c8c9dcd >2013-12-04 07:10:46,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7305f2 >2013-12-04 07:10:46,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fe1f43e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82a7dd2b}, log id: 7305f2 >2013-12-04 07:10:51,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 9f6cb27 >2013-12-04 07:10:52,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 9f6cb27 >2013-12-04 07:10:52,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41e47e92 >2013-12-04 07:10:52,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b2770c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@862e5ab7}, log id: 41e47e92 >2013-12-04 07:10:57,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59e293cd >2013-12-04 07:10:58,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59e293cd >2013-12-04 07:10:58,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f9bf842 >2013-12-04 07:10:58,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e22d886f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@360a8a01}, log id: 7f9bf842 >2013-12-04 07:11:03,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 50b803e0 >2013-12-04 07:11:04,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 50b803e0 >2013-12-04 07:11:04,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5291dd3a >2013-12-04 07:11:04,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cbec841, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc15f7e7}, log id: 5291dd3a >2013-12-04 07:11:06,363 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-04 07:11:06,363 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:11:06,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20e5b84b >2013-12-04 07:11:06,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 20e5b84b >2013-12-04 07:11:09,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3bacaba7 >2013-12-04 07:11:09,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 3bacaba7 >2013-12-04 07:11:09,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e7cd951 >2013-12-04 07:11:10,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd2d8cce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b1ca390}, log id: 3e7cd951 >2013-12-04 07:11:15,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ca34300 >2013-12-04 07:11:15,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ca34300 >2013-12-04 07:11:15,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 79782c7b >2013-12-04 07:11:16,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a2763c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59dd2189}, log id: 79782c7b >2013-12-04 07:11:21,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79c2dea0 >2013-12-04 07:11:21,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 79c2dea0 >2013-12-04 07:11:21,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3592493d >2013-12-04 07:11:21,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a01676c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f4af9cc}, log id: 3592493d >2013-12-04 07:11:26,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c52ecb9 >2013-12-04 07:11:27,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c52ecb9 >2013-12-04 07:11:27,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9d2e9c1 >2013-12-04 07:11:27,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27e04382, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@320b0f4b}, log id: 9d2e9c1 >2013-12-04 07:11:32,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40425e61 >2013-12-04 07:11:33,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 40425e61 >2013-12-04 07:11:33,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55649ffa >2013-12-04 07:11:33,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bcadd05, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c55e5ef}, log id: 55649ffa >2013-12-04 07:11:38,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 50f8c134 >2013-12-04 07:11:39,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 50f8c134 >2013-12-04 07:11:39,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ad606f4 >2013-12-04 07:11:39,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75fdcf77, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6955caaf}, log id: 3ad606f4 >2013-12-04 07:11:44,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4477d9b3 >2013-12-04 07:11:44,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4477d9b3 >2013-12-04 07:11:44,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5420af68 >2013-12-04 07:11:45,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91549524, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6038290f}, log id: 5420af68 >2013-12-04 07:11:50,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: c60d6d4 >2013-12-04 07:11:50,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c60d6d4 >2013-12-04 07:11:50,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 143ff099 >2013-12-04 07:11:50,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99f5c394, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcb43557}, log id: 143ff099 >2013-12-04 07:11:51,021 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-2) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:11:51,257 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-12) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:11:55,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1bb1df6 >2013-12-04 07:11:56,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bb1df6 >2013-12-04 07:11:56,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 625d1d27 >2013-12-04 07:11:56,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a43f254, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88149850}, log id: 625d1d27 >2013-12-04 07:11:56,955 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-6) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:11:57,201 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:12:01,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f51a564 >2013-12-04 07:12:02,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f51a564 >2013-12-04 07:12:02,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 354822a7 >2013-12-04 07:12:02,427 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-17) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:12:02,491 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-8) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:12:02,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a80a241d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba38ad0d}, log id: 354822a7 >2013-12-04 07:12:03,263 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-10) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:12:04,517 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-4) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:12:04,752 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-7) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:12:06,079 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-3) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:12:06,231 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-13) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:12:06,664 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-04 07:12:06,664 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:12:06,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6300f294 >2013-12-04 07:12:06,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6300f294 >2013-12-04 07:12:07,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 61c668b7 >2013-12-04 07:12:08,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 61c668b7 >2013-12-04 07:12:08,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19525932 >2013-12-04 07:12:08,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc940a6c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc554d9e}, log id: 19525932 >2013-12-04 07:12:08,650 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-6) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:12:08,728 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:12:12,618 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-8) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:12:13,375 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-2) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:12:13,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70c9a3cb >2013-12-04 07:12:13,562 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-12) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 07:12:13,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 70c9a3cb >2013-12-04 07:12:13,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b34abd2 >2013-12-04 07:12:14,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1ac7fe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6fa4872}, log id: 3b34abd2 >2013-12-04 07:12:19,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73d81c2f >2013-12-04 07:12:19,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 73d81c2f >2013-12-04 07:12:19,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 21a77305 >2013-12-04 07:12:20,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d82d9e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79d4f19f}, log id: 21a77305 >2013-12-04 07:12:25,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 552f333f >2013-12-04 07:12:25,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 552f333f >2013-12-04 07:12:25,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f25212a >2013-12-04 07:12:25,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d9aa4eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86f6884e}, log id: 1f25212a >2013-12-04 07:12:30,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 17726385 >2013-12-04 07:12:31,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 17726385 >2013-12-04 07:12:31,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d59720b >2013-12-04 07:12:31,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7de8a28e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dd5fff7}, log id: 6d59720b >2013-12-04 07:12:36,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5cb3b37d >2013-12-04 07:12:37,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 5cb3b37d >2013-12-04 07:12:37,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47c06586 >2013-12-04 07:12:37,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4018ff8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cb4ea6c}, log id: 47c06586 >2013-12-04 07:12:42,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5e10939f >2013-12-04 07:12:43,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 5e10939f >2013-12-04 07:12:43,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f3fdb8d >2013-12-04 07:12:43,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd28ec11, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df8439ab}, log id: 7f3fdb8d >2013-12-04 07:12:48,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 615a4084 >2013-12-04 07:12:48,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 615a4084 >2013-12-04 07:12:48,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6d6a1754 >2013-12-04 07:12:49,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b2501d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a1080a3}, log id: 6d6a1754 >2013-12-04 07:12:54,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ae87fd0 >2013-12-04 07:12:54,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: ae87fd0 >2013-12-04 07:12:54,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 64dffc03 >2013-12-04 07:12:54,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7400f8cc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c71914fa}, log id: 64dffc03 >2013-12-04 07:13:00,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67b7438a >2013-12-04 07:13:00,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67b7438a >2013-12-04 07:13:00,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ff00e55 >2013-12-04 07:13:00,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@750d407a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9cfc654}, log id: ff00e55 >2013-12-04 07:13:05,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 147b2175 >2013-12-04 07:13:06,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 147b2175 >2013-12-04 07:13:06,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4ee3a1f0 >2013-12-04 07:13:06,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92bdbb39, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e611e4b}, log id: 4ee3a1f0 >2013-12-04 07:13:06,967 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-04 07:13:06,967 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:13:06,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 27994597 >2013-12-04 07:13:07,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 27994597 >2013-12-04 07:13:11,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 786ebcb8 >2013-12-04 07:13:12,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 786ebcb8 >2013-12-04 07:13:12,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: efde4a7 >2013-12-04 07:13:12,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5040ed8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49ab47e2}, log id: efde4a7 >2013-12-04 07:13:17,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5ab7413a >2013-12-04 07:13:18,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ab7413a >2013-12-04 07:13:18,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 52a108cc >2013-12-04 07:13:18,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c0b3161, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a67e3224}, log id: 52a108cc >2013-12-04 07:13:23,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d6c55fc >2013-12-04 07:13:23,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d6c55fc >2013-12-04 07:13:23,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12725b59 >2013-12-04 07:13:24,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c24c63ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4338b396}, log id: 12725b59 >2013-12-04 07:13:29,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 280cbd3f >2013-12-04 07:13:29,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 280cbd3f >2013-12-04 07:13:29,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7d97ebe3 >2013-12-04 07:13:29,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@707c0686, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e305487e}, log id: 7d97ebe3 >2013-12-04 07:13:34,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 38fe6eee >2013-12-04 07:13:35,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38fe6eee >2013-12-04 07:13:35,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7fe3f428 >2013-12-04 07:13:35,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98961350, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cde5130}, log id: 7fe3f428 >2013-12-04 07:13:40,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b8e21b >2013-12-04 07:13:41,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b8e21b >2013-12-04 07:13:41,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43911866 >2013-12-04 07:13:41,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9757a56, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d17fa63}, log id: 43911866 >2013-12-04 07:13:46,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f11cf2a >2013-12-04 07:13:47,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7f11cf2a >2013-12-04 07:13:47,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: e66f921 >2013-12-04 07:13:47,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16e70951, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45322cf6}, log id: e66f921 >2013-12-04 07:13:52,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 112b4ef8 >2013-12-04 07:13:52,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 112b4ef8 >2013-12-04 07:13:52,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5a2fbd6c >2013-12-04 07:13:53,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3143aa7c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@713b3d28}, log id: 5a2fbd6c >2013-12-04 07:13:58,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 23cbd499 >2013-12-04 07:13:58,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23cbd499 >2013-12-04 07:13:58,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f72e30 >2013-12-04 07:13:59,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c6d0ee8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a971524}, log id: 7f72e30 >2013-12-04 07:14:04,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 49d84e6a >2013-12-04 07:14:04,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 49d84e6a >2013-12-04 07:14:04,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3e4dbc1b >2013-12-04 07:14:04,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c306c55, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3bcf2f4}, log id: 3e4dbc1b >2013-12-04 07:14:07,269 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) No up server in cluster >2013-12-04 07:14:07,269 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:14:07,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12381a8 >2013-12-04 07:14:07,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterTasksListVDSCommand, return: [], log id: 12381a8 >2013-12-04 07:14:09,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5e9c4dee >2013-12-04 07:14:10,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e9c4dee >2013-12-04 07:14:10,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5854bef3 >2013-12-04 07:14:10,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f72d5acc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e232f2f4}, log id: 5854bef3 >2013-12-04 07:14:15,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2bb955ff >2013-12-04 07:14:15,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@585524db, log id: 2bb955ff >2013-12-04 07:14:15,435 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [6e7f0088] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected change in status of brick 10.70.37.74:/rhs/brick5/b3 of volume dis_rep_vol from DOWN to UP. >2013-12-04 07:14:15,448 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [6e7f0088] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected change in status of brick 10.70.37.74:/rhs/brick4/b1 of volume dis_rep_vol from DOWN to UP. >2013-12-04 07:14:15,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4d23ab11 >2013-12-04 07:14:15,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@633197e0, log id: 4d23ab11 >2013-12-04 07:14:15,758 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [6e7f0088] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected change in status of brick 10.70.37.74:/rhs/brick1/b1 of volume dis_vol from DOWN to UP. >2013-12-04 07:14:15,757 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-66) [451f957d] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 07:14:15,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3fe046e0 >2013-12-04 07:14:16,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 3fe046e0 >2013-12-04 07:14:16,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ee3ff21 >2013-12-04 07:14:16,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79ae7a82, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1e2c198}, log id: 1ee3ff21 >2013-12-04 07:14:21,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 319f3933 >2013-12-04 07:14:22,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 319f3933 >2013-12-04 07:14:22,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48fdc0e2 >2013-12-04 07:14:22,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@477fc544, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c8bdfe6}, log id: 48fdc0e2 >2013-12-04 07:14:27,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 61575f8f >2013-12-04 07:14:27,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 61575f8f >2013-12-04 07:14:27,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b7ab008 >2013-12-04 07:14:28,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a87fd150, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ae2e61a}, log id: 6b7ab008 >2013-12-04 07:14:33,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a99b2cf >2013-12-04 07:14:33,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 1a99b2cf >2013-12-04 07:14:33,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5d97a502 >2013-12-04 07:14:34,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@906fe997, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19567eff}, log id: 5d97a502 >2013-12-04 07:14:39,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4c30803e >2013-12-04 07:14:39,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c30803e >2013-12-04 07:14:39,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5550908b >2013-12-04 07:14:39,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d8573f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@533bce4a}, log id: 5550908b >2013-12-04 07:14:44,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a5ecc4c >2013-12-04 07:14:45,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a5ecc4c >2013-12-04 07:14:45,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43a530b4 >2013-12-04 07:14:45,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d8e1bf6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1b7b604}, log id: 43a530b4 >2013-12-04 07:14:50,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5dc22dc0 >2013-12-04 07:14:51,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5dc22dc0 >2013-12-04 07:14:51,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4219526 >2013-12-04 07:14:51,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4528590d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b86551eb}, log id: 4219526 >2013-12-04 07:14:56,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ca83f2 >2013-12-04 07:14:57,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ca83f2 >2013-12-04 07:14:57,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 60fe1f0a >2013-12-04 07:14:57,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce923757, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6388ea6}, log id: 60fe1f0a >2013-12-04 07:15:02,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e9a55da >2013-12-04 07:15:02,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e9a55da >2013-12-04 07:15:02,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6229a0dd >2013-12-04 07:15:03,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b3aa4c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77736c3}, log id: 6229a0dd >2013-12-04 07:15:07,595 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-04 07:15:07,595 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:15:07,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78190653 >2013-12-04 07:15:07,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 78190653 >2013-12-04 07:15:08,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a44ed49 >2013-12-04 07:15:08,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7a44ed49 >2013-12-04 07:15:08,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59b90927 >2013-12-04 07:15:08,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b0d29bd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef83545d}, log id: 59b90927 >2013-12-04 07:15:14,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4045d2fc >2013-12-04 07:15:14,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4045d2fc >2013-12-04 07:15:14,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6daaae62 >2013-12-04 07:15:14,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85d3d3a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab81dde3}, log id: 6daaae62 >2013-12-04 07:15:19,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 65a4a058 >2013-12-04 07:15:20,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 65a4a058 >2013-12-04 07:15:20,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19246c35 >2013-12-04 07:15:20,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@129fd741, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23610083}, log id: 19246c35 >2013-12-04 07:15:25,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43e05a9b >2013-12-04 07:15:26,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43e05a9b >2013-12-04 07:15:26,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 236234b0 >2013-12-04 07:15:26,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac01d7bf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c6916b3}, log id: 236234b0 >2013-12-04 07:15:31,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76c5abe0 >2013-12-04 07:15:31,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76c5abe0 >2013-12-04 07:15:31,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 42031c1b >2013-12-04 07:15:32,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64d6f1d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a74aa8}, log id: 42031c1b >2013-12-04 07:15:37,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 55308b06 >2013-12-04 07:15:37,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 55308b06 >2013-12-04 07:15:37,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5bad90fe >2013-12-04 07:15:38,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5299ec97, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2866f2a7}, log id: 5bad90fe >2013-12-04 07:15:43,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1480681b >2013-12-04 07:15:43,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1480681b >2013-12-04 07:15:43,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1aa0525d >2013-12-04 07:15:43,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a9c48fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@669a4963}, log id: 1aa0525d >2013-12-04 07:15:48,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4d5ec81d >2013-12-04 07:15:49,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d5ec81d >2013-12-04 07:15:49,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45c63bbc >2013-12-04 07:15:49,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abc47bf8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a598a9b}, log id: 45c63bbc >2013-12-04 07:15:54,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d477853 >2013-12-04 07:15:55,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d477853 >2013-12-04 07:15:55,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d9bf81e >2013-12-04 07:15:55,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8819db5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8e9b1b8}, log id: 2d9bf81e >2013-12-04 07:16:00,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 406f3c79 >2013-12-04 07:16:01,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 406f3c79 >2013-12-04 07:16:01,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f4f9aec >2013-12-04 07:16:01,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81decf15, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4837ce76}, log id: 5f4f9aec >2013-12-04 07:16:06,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3fdf0332 >2013-12-04 07:16:06,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fdf0332 >2013-12-04 07:16:06,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14b8db56 >2013-12-04 07:16:07,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6372919, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17d36d6f}, log id: 14b8db56 >2013-12-04 07:16:07,907 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) No up server in cluster >2013-12-04 07:16:07,907 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:16:07,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22ffef44 >2013-12-04 07:16:08,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, return: [], log id: 22ffef44 >2013-12-04 07:16:12,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47aa5605 >2013-12-04 07:16:12,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 47aa5605 >2013-12-04 07:16:12,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 434c683f >2013-12-04 07:16:13,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b24ac3f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@777e87fc}, log id: 434c683f >2013-12-04 07:16:18,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 726816e7 >2013-12-04 07:16:18,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 726816e7 >2013-12-04 07:16:18,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 44ccb923 >2013-12-04 07:16:18,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f652352d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d70e3590}, log id: 44ccb923 >2013-12-04 07:16:23,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c06c8c4 >2013-12-04 07:16:24,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: c06c8c4 >2013-12-04 07:16:24,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 25020097 >2013-12-04 07:16:24,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f29c961d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6cd8882}, log id: 25020097 >2013-12-04 07:16:29,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1863366a >2013-12-04 07:16:30,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 1863366a >2013-12-04 07:16:30,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b28ee2 >2013-12-04 07:16:30,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71c2d271, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bab041d}, log id: 4b28ee2 >2013-12-04 07:16:35,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 536631b9 >2013-12-04 07:16:35,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 536631b9 >2013-12-04 07:16:35,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6daf475d >2013-12-04 07:16:36,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@648828ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@536cdff1}, log id: 6daf475d >2013-12-04 07:16:41,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ae0cb10 >2013-12-04 07:16:41,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ae0cb10 >2013-12-04 07:16:41,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b0f6fe5 >2013-12-04 07:16:42,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@153c30a6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a7fbc1b}, log id: 5b0f6fe5 >2013-12-04 07:16:47,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59a61736 >2013-12-04 07:16:47,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 59a61736 >2013-12-04 07:16:47,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4dc03c0b >2013-12-04 07:16:47,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@550b6bf6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4337294}, log id: 4dc03c0b >2013-12-04 07:16:52,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4beef884 >2013-12-04 07:16:53,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 4beef884 >2013-12-04 07:16:53,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 61e05c5e >2013-12-04 07:16:53,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ca7da81, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1636faa9}, log id: 61e05c5e >2013-12-04 07:16:58,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f0f571f >2013-12-04 07:16:59,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 6f0f571f >2013-12-04 07:16:59,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 61026957 >2013-12-04 07:16:59,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4db06f27, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad38b075}, log id: 61026957 >2013-12-04 07:17:04,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2a81897 >2013-12-04 07:17:04,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a81897 >2013-12-04 07:17:04,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7b4ae21d >2013-12-04 07:17:05,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbbb3d03, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1375b9ec}, log id: 7b4ae21d >2013-12-04 07:17:08,213 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) No up server in cluster >2013-12-04 07:17:08,213 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:17:08,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: dc1981 >2013-12-04 07:17:08,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, return: [], log id: dc1981 >2013-12-04 07:17:10,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 56dd3e44 >2013-12-04 07:17:10,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 56dd3e44 >2013-12-04 07:17:10,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9217c99 >2013-12-04 07:17:11,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1de8dac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d24fcda0}, log id: 9217c99 >2013-12-04 07:17:16,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: bc11f3 >2013-12-04 07:17:16,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: bc11f3 >2013-12-04 07:17:16,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4525d179 >2013-12-04 07:17:16,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68e3bf9f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2efc6305}, log id: 4525d179 >2013-12-04 07:17:21,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41becdd0 >2013-12-04 07:17:22,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41becdd0 >2013-12-04 07:17:22,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56770332 >2013-12-04 07:17:22,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c3c12f4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@513c0be3}, log id: 56770332 >2013-12-04 07:17:27,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34802936 >2013-12-04 07:17:28,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34802936 >2013-12-04 07:17:28,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 38fe3b48 >2013-12-04 07:17:28,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54098686, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c242907}, log id: 38fe3b48 >2013-12-04 07:17:33,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5e16ecf7 >2013-12-04 07:17:34,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e16ecf7 >2013-12-04 07:17:34,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 10d03612 >2013-12-04 07:17:34,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cc74b1c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31f49ba4}, log id: 10d03612 >2013-12-04 07:17:39,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7c909840 >2013-12-04 07:17:39,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c909840 >2013-12-04 07:17:39,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69339d3d >2013-12-04 07:17:40,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69682c98, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba6ccbe0}, log id: 69339d3d >2013-12-04 07:17:45,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79af874e >2013-12-04 07:17:45,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 79af874e >2013-12-04 07:17:45,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 66d22639 >2013-12-04 07:17:45,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cc26be5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8dc67aa}, log id: 66d22639 >2013-12-04 07:17:50,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b9ad27b >2013-12-04 07:17:51,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b9ad27b >2013-12-04 07:17:51,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5294a495 >2013-12-04 07:17:51,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34d75723, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0d1921f}, log id: 5294a495 >2013-12-04 07:17:56,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 440b8d89 >2013-12-04 07:17:57,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 440b8d89 >2013-12-04 07:17:57,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4fbb8c10 >2013-12-04 07:17:57,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59cacc6f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f0560ad}, log id: 4fbb8c10 >2013-12-04 07:18:02,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d9e5f08 >2013-12-04 07:18:03,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d9e5f08 >2013-12-04 07:18:03,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75c5780d >2013-12-04 07:18:03,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21d72650, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9550c441}, log id: 75c5780d >2013-12-04 07:18:08,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5c09838a >2013-12-04 07:18:08,519 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2013-12-04 07:18:08,519 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:18:08,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d79df02 >2013-12-04 07:18:08,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6d79df02 >2013-12-04 07:18:08,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c09838a >2013-12-04 07:18:08,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e406fe >2013-12-04 07:18:09,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4be13dd5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7a79776}, log id: 5e406fe >2013-12-04 07:18:14,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 343d769d >2013-12-04 07:18:14,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 343d769d >2013-12-04 07:18:14,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 32c55ee8 >2013-12-04 07:18:14,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2355b1b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15b6a285}, log id: 32c55ee8 >2013-12-04 07:18:20,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 36769b2e >2013-12-04 07:18:20,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36769b2e >2013-12-04 07:18:20,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a511f7 >2013-12-04 07:18:20,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@918d8cde, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a58ccd7}, log id: a511f7 >2013-12-04 07:18:25,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 651c9fb5 >2013-12-04 07:18:26,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 651c9fb5 >2013-12-04 07:18:26,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 535b2175 >2013-12-04 07:18:26,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b33897db, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88b62a7}, log id: 535b2175 >2013-12-04 07:18:31,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 306c9785 >2013-12-04 07:18:32,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 306c9785 >2013-12-04 07:18:32,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63530858 >2013-12-04 07:18:32,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@835454bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4497acb}, log id: 63530858 >2013-12-04 07:18:37,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7dbf6374 >2013-12-04 07:18:37,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7dbf6374 >2013-12-04 07:18:37,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 55f2dace >2013-12-04 07:18:38,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0ab32a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53b997e7}, log id: 55f2dace >2013-12-04 07:18:43,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 66daf74e >2013-12-04 07:18:43,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 66daf74e >2013-12-04 07:18:43,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4161c3ff >2013-12-04 07:18:44,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c8dbb1a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14317f4b}, log id: 4161c3ff >2013-12-04 07:18:49,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 38eed83 >2013-12-04 07:18:49,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38eed83 >2013-12-04 07:18:49,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 28c03cc7 >2013-12-04 07:18:49,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59f677b4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fef3556f}, log id: 28c03cc7 >2013-12-04 07:18:54,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: df4da5a >2013-12-04 07:18:55,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: df4da5a >2013-12-04 07:18:55,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f6746d8 >2013-12-04 07:18:55,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bba55e4d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ab5b9f6}, log id: 4f6746d8 >2013-12-04 07:19:00,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5e4e6f86 >2013-12-04 07:19:01,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e4e6f86 >2013-12-04 07:19:01,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 74ea1488 >2013-12-04 07:19:01,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed1232ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e783d273}, log id: 74ea1488 >2013-12-04 07:19:06,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1db71784 >2013-12-04 07:19:07,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1db71784 >2013-12-04 07:19:07,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 332f29d0 >2013-12-04 07:19:07,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d084d34, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29adce6c}, log id: 332f29d0 >2013-12-04 07:19:08,836 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) No up server in cluster >2013-12-04 07:19:08,836 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:19:08,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 686e7048 >2013-12-04 07:19:09,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterTasksListVDSCommand, return: [], log id: 686e7048 >2013-12-04 07:19:12,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a6fbc8c >2013-12-04 07:19:12,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a6fbc8c >2013-12-04 07:19:12,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6183f031 >2013-12-04 07:19:13,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3ce0836, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fd7a834}, log id: 6183f031 >2013-12-04 07:19:15,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b81949b >2013-12-04 07:19:16,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2cf7d751, log id: 5b81949b >2013-12-04 07:19:16,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43591de7 >2013-12-04 07:19:16,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@732f3911, log id: 43591de7 >2013-12-04 07:19:18,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2deb3f93 >2013-12-04 07:19:18,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2deb3f93 >2013-12-04 07:19:18,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7138b192 >2013-12-04 07:19:19,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9c8757d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@204c0192}, log id: 7138b192 >2013-12-04 07:19:24,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c593170 >2013-12-04 07:19:24,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: c593170 >2013-12-04 07:19:24,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4fb5bee3 >2013-12-04 07:19:24,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbd81599, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ac86298}, log id: 4fb5bee3 >2013-12-04 07:19:29,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67b19c1 >2013-12-04 07:19:30,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 67b19c1 >2013-12-04 07:19:30,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 584d85c2 >2013-12-04 07:19:30,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba2fce77, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@299f16e4}, log id: 584d85c2 >2013-12-04 07:19:35,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4c53e720 >2013-12-04 07:19:36,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c53e720 >2013-12-04 07:19:36,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 590d322f >2013-12-04 07:19:36,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8436e9d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4346ce48}, log id: 590d322f >2013-12-04 07:19:41,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 21377521 >2013-12-04 07:19:42,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 21377521 >2013-12-04 07:19:42,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 297cdb52 >2013-12-04 07:19:42,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ba83e17, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8911210e}, log id: 297cdb52 >2013-12-04 07:19:47,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f81b90 >2013-12-04 07:19:47,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 4f81b90 >2013-12-04 07:19:47,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f856eea >2013-12-04 07:19:48,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d36b0238, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfd888c9}, log id: 3f856eea >2013-12-04 07:19:53,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7dc2bb1e >2013-12-04 07:19:53,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7dc2bb1e >2013-12-04 07:19:53,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 608cfcef >2013-12-04 07:19:54,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f04060c7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaa34676}, log id: 608cfcef >2013-12-04 07:19:59,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f93937b >2013-12-04 07:19:59,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f93937b >2013-12-04 07:19:59,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5fe6bf7 >2013-12-04 07:19:59,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fd63447, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d3ac79a}, log id: 5fe6bf7 >2013-12-04 07:20:04,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 487feaa >2013-12-04 07:20:05,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 487feaa >2013-12-04 07:20:05,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6eca5a90 >2013-12-04 07:20:05,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15e96bc1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4b65ea8}, log id: 6eca5a90 >2013-12-04 07:20:09,135 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-04 07:20:09,136 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:20:09,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1714deb1 >2013-12-04 07:20:09,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1714deb1 >2013-12-04 07:20:10,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d47ef41 >2013-12-04 07:20:11,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7d47ef41 >2013-12-04 07:20:11,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 531c825a >2013-12-04 07:20:11,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6ed4459, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92721d86}, log id: 531c825a >2013-12-04 07:20:16,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73e9723a >2013-12-04 07:20:16,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 73e9723a >2013-12-04 07:20:17,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1357bc45 >2013-12-04 07:20:17,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9101f8d0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@299decc2}, log id: 1357bc45 >2013-12-04 07:20:22,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 98dad4f >2013-12-04 07:20:22,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 98dad4f >2013-12-04 07:20:22,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 245d022f >2013-12-04 07:20:23,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78e8a6ce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbbe9f92}, log id: 245d022f >2013-12-04 07:20:28,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ffb7ea9 >2013-12-04 07:20:28,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 3ffb7ea9 >2013-12-04 07:20:28,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 494a5f79 >2013-12-04 07:20:28,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5890f60f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc724a77}, log id: 494a5f79 >2013-12-04 07:20:33,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9928914 >2013-12-04 07:20:34,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 9928914 >2013-12-04 07:20:34,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 613c71b0 >2013-12-04 07:20:34,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae6b2f6a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1348194e}, log id: 613c71b0 >2013-12-04 07:20:39,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e52a035 >2013-12-04 07:20:40,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e52a035 >2013-12-04 07:20:40,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 619d928a >2013-12-04 07:20:40,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8261a408, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4382607e}, log id: 619d928a >2013-12-04 07:20:45,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2efa2b8f >2013-12-04 07:20:46,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 2efa2b8f >2013-12-04 07:20:46,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1090ddb7 >2013-12-04 07:20:46,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0f52ffb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2584affa}, log id: 1090ddb7 >2013-12-04 07:20:51,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 764a76a2 >2013-12-04 07:20:51,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 764a76a2 >2013-12-04 07:20:51,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55084e2a >2013-12-04 07:20:52,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46760f9b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12c82695}, log id: 55084e2a >2013-12-04 07:20:57,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 627cef82 >2013-12-04 07:20:57,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 627cef82 >2013-12-04 07:20:57,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53eb54c2 >2013-12-04 07:20:57,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53babff5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ce64cf9}, log id: 53eb54c2 >2013-12-04 07:21:02,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 23f8e6b5 >2013-12-04 07:21:03,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23f8e6b5 >2013-12-04 07:21:03,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58b2e1cd >2013-12-04 07:21:03,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@968963ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c525b107}, log id: 58b2e1cd >2013-12-04 07:21:08,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d7020d0 >2013-12-04 07:21:09,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d7020d0 >2013-12-04 07:21:09,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6cda363f >2013-12-04 07:21:09,436 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-04 07:21:09,436 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:21:09,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27632d6b >2013-12-04 07:21:09,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f5e716d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5259ab24}, log id: 6cda363f >2013-12-04 07:21:09,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 27632d6b >2013-12-04 07:21:14,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12272943 >2013-12-04 07:21:15,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 12272943 >2013-12-04 07:21:15,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7bc367a9 >2013-12-04 07:21:15,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f7ab47f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29365446}, log id: 7bc367a9 >2013-12-04 07:21:20,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 37c9b6f >2013-12-04 07:21:20,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 37c9b6f >2013-12-04 07:21:20,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7bec08f9 >2013-12-04 07:21:21,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54ff3eeb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0946a51}, log id: 7bec08f9 >2013-12-04 07:21:26,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69557081 >2013-12-04 07:21:26,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69557081 >2013-12-04 07:21:26,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ac6ad88 >2013-12-04 07:21:27,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95aeea27, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@741d2f42}, log id: 7ac6ad88 >2013-12-04 07:21:32,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e6c813f >2013-12-04 07:21:32,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e6c813f >2013-12-04 07:21:32,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 116ea6fc >2013-12-04 07:21:32,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab85dc93, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2059f7e3}, log id: 116ea6fc >2013-12-04 07:21:37,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ba1327 >2013-12-04 07:21:38,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ba1327 >2013-12-04 07:21:38,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 473367b6 >2013-12-04 07:21:38,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d40fc711, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@283bd05f}, log id: 473367b6 >2013-12-04 07:21:43,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 569fa48 >2013-12-04 07:21:44,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 569fa48 >2013-12-04 07:21:44,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5221b72b >2013-12-04 07:21:44,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3354a30c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70676f1d}, log id: 5221b72b >2013-12-04 07:21:49,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 57a6f49b >2013-12-04 07:21:50,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 57a6f49b >2013-12-04 07:21:50,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55104ceb >2013-12-04 07:21:50,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35080ac5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e7722fc}, log id: 55104ceb >2013-12-04 07:21:55,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 243cfa04 >2013-12-04 07:21:55,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 243cfa04 >2013-12-04 07:21:55,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59500ad3 >2013-12-04 07:21:56,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f8e1876, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95e292d8}, log id: 59500ad3 >2013-12-04 07:22:01,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42662fb6 >2013-12-04 07:22:01,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 42662fb6 >2013-12-04 07:22:01,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2da0b533 >2013-12-04 07:22:02,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db3f4ec0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21cbd4e9}, log id: 2da0b533 >2013-12-04 07:22:07,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12f38995 >2013-12-04 07:22:07,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12f38995 >2013-12-04 07:22:07,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e195203 >2013-12-04 07:22:07,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b4fc14b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1508dacc}, log id: 7e195203 >2013-12-04 07:22:09,730 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) No up server in cluster >2013-12-04 07:22:09,730 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:22:09,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1afa9544 >2013-12-04 07:22:10,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1afa9544 >2013-12-04 07:22:12,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19992162 >2013-12-04 07:22:13,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 19992162 >2013-12-04 07:22:13,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54fc5ee >2013-12-04 07:22:13,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe8a8c4f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@558988d2}, log id: 54fc5ee >2013-12-04 07:22:18,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7b88a4e2 >2013-12-04 07:22:19,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b88a4e2 >2013-12-04 07:22:19,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4fb5fe90 >2013-12-04 07:22:19,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcc12805, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@530c7af9}, log id: 4fb5fe90 >2013-12-04 07:22:24,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59b1b0db >2013-12-04 07:22:24,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 59b1b0db >2013-12-04 07:22:24,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ca74fde >2013-12-04 07:22:25,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abb20b75, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f6dfa21}, log id: 3ca74fde >2013-12-04 07:22:30,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54eba81e >2013-12-04 07:22:30,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 54eba81e >2013-12-04 07:22:30,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f1bab89 >2013-12-04 07:22:31,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a28698c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae2d827d}, log id: 6f1bab89 >2013-12-04 07:22:36,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2f5d1fb >2013-12-04 07:22:36,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f5d1fb >2013-12-04 07:22:36,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6fec97e0 >2013-12-04 07:22:36,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@982938f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4596b842}, log id: 6fec97e0 >2013-12-04 07:22:41,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 60ebdf01 >2013-12-04 07:22:42,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60ebdf01 >2013-12-04 07:22:42,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 409717c4 >2013-12-04 07:22:42,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e19c1a7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5b484e4}, log id: 409717c4 >2013-12-04 07:22:47,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14ead052 >2013-12-04 07:22:48,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 14ead052 >2013-12-04 07:22:48,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2be68a14 >2013-12-04 07:22:48,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56100b47, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93185d2d}, log id: 2be68a14 >2013-12-04 07:22:53,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38ba0e9f >2013-12-04 07:22:54,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 38ba0e9f >2013-12-04 07:22:54,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 67ccfc41 >2013-12-04 07:22:54,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa929a67, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46ed324c}, log id: 67ccfc41 >2013-12-04 07:22:59,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63375c09 >2013-12-04 07:22:59,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63375c09 >2013-12-04 07:22:59,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6dd50ef7 >2013-12-04 07:23:00,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb19f310, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89363f51}, log id: 6dd50ef7 >2013-12-04 07:23:05,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4661fc6e >2013-12-04 07:23:05,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 4661fc6e >2013-12-04 07:23:05,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53b97775 >2013-12-04 07:23:05,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1595b28f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fc348b9}, log id: 53b97775 >2013-12-04 07:23:10,068 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) [451f957d] No up server in cluster >2013-12-04 07:23:10,068 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) [451f957d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:23:10,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b30ca61 >2013-12-04 07:23:10,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5b30ca61 >2013-12-04 07:23:10,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 260f25c >2013-12-04 07:23:11,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 260f25c >2013-12-04 07:23:11,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 40e7716 >2013-12-04 07:23:11,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e71dcbef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ace68fad}, log id: 40e7716 >2013-12-04 07:23:16,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7852d225 >2013-12-04 07:23:17,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7852d225 >2013-12-04 07:23:17,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 23973e2a >2013-12-04 07:23:17,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56ca5731, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de171441}, log id: 23973e2a >2013-12-04 07:23:22,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7426dc17 >2013-12-04 07:23:23,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7426dc17 >2013-12-04 07:23:23,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 58b5648d >2013-12-04 07:23:23,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e517d67b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f172cc22}, log id: 58b5648d >2013-12-04 07:23:28,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d43bd5a >2013-12-04 07:23:28,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d43bd5a >2013-12-04 07:23:28,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5742cb9d >2013-12-04 07:23:29,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c76a888f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5010dc23}, log id: 5742cb9d >2013-12-04 07:23:34,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6433c733 >2013-12-04 07:23:34,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 6433c733 >2013-12-04 07:23:34,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a195211 >2013-12-04 07:23:35,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be63dfc7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a663d128}, log id: 1a195211 >2013-12-04 07:23:40,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b78e6ac >2013-12-04 07:23:40,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 4b78e6ac >2013-12-04 07:23:40,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 113cbeb6 >2013-12-04 07:23:40,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c28a3ff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb64bbb7}, log id: 113cbeb6 >2013-12-04 07:23:45,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3eb38e2 >2013-12-04 07:23:46,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 3eb38e2 >2013-12-04 07:23:46,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 665e56a8 >2013-12-04 07:23:46,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7e5ab5b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ac944c2}, log id: 665e56a8 >2013-12-04 07:23:51,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 155ac3b7 >2013-12-04 07:23:52,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 155ac3b7 >2013-12-04 07:23:52,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5cbc0a8d >2013-12-04 07:23:52,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dd68470, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef1a5c4e}, log id: 5cbc0a8d >2013-12-04 07:23:57,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3667761 >2013-12-04 07:23:58,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3667761 >2013-12-04 07:23:58,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 76ca201e >2013-12-04 07:23:58,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35def530, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce9837d}, log id: 76ca201e >2013-12-04 07:24:03,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: f56985c >2013-12-04 07:24:03,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: f56985c >2013-12-04 07:24:03,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39eec9d1 >2013-12-04 07:24:04,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9678f235, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e457010}, log id: 39eec9d1 >2013-12-04 07:24:09,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55f8fd97 >2013-12-04 07:24:09,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 55f8fd97 >2013-12-04 07:24:09,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 416cf200 >2013-12-04 07:24:10,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd342355, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb382456}, log id: 416cf200 >2013-12-04 07:24:10,377 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) No up server in cluster >2013-12-04 07:24:10,377 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:24:10,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 629df50b >2013-12-04 07:24:10,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, return: [], log id: 629df50b >2013-12-04 07:24:15,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1be599e6 >2013-12-04 07:24:15,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1be599e6 >2013-12-04 07:24:15,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11588581 >2013-12-04 07:24:15,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52395933, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c39ee67}, log id: 11588581 >2013-12-04 07:24:16,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 296e0a7c >2013-12-04 07:24:16,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@62b20298, log id: 296e0a7c >2013-12-04 07:24:16,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 14c87bc7 >2013-12-04 07:24:16,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@56f6fff3, log id: 14c87bc7 >2013-12-04 07:24:20,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6d56468f >2013-12-04 07:24:21,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 6d56468f >2013-12-04 07:24:21,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1cf6be3a >2013-12-04 07:24:21,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea983d86, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9fe9a10}, log id: 1cf6be3a >2013-12-04 07:24:26,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f29fc13 >2013-12-04 07:24:27,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 6f29fc13 >2013-12-04 07:24:27,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 254e839d >2013-12-04 07:24:27,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbfb647e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbf78fdd}, log id: 254e839d >2013-12-04 07:24:32,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7d27db4d >2013-12-04 07:24:33,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d27db4d >2013-12-04 07:24:33,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 36ce7ebd >2013-12-04 07:24:33,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fad9c83, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bb180e0}, log id: 36ce7ebd >2013-12-04 07:24:38,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 58ed434b >2013-12-04 07:24:38,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 58ed434b >2013-12-04 07:24:38,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 208b21cf >2013-12-04 07:24:39,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@465edfa8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a19f366}, log id: 208b21cf >2013-12-04 07:24:44,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5882d60a >2013-12-04 07:24:44,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5882d60a >2013-12-04 07:24:44,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1be0eba7 >2013-12-04 07:24:44,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b36e2da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc9993c6}, log id: 1be0eba7 >2013-12-04 07:24:49,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63047b8d >2013-12-04 07:24:50,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 63047b8d >2013-12-04 07:24:50,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 168f0b37 >2013-12-04 07:24:50,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c85d1b46, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e06f4e4f}, log id: 168f0b37 >2013-12-04 07:24:55,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ebe1bb9 >2013-12-04 07:24:56,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ebe1bb9 >2013-12-04 07:24:56,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5025a852 >2013-12-04 07:24:56,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9b41ac6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf6cd90f}, log id: 5025a852 >2013-12-04 07:25:01,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1aeb2b10 >2013-12-04 07:25:02,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1aeb2b10 >2013-12-04 07:25:02,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 244fd2ee >2013-12-04 07:25:02,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d32921b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@841f4046}, log id: 244fd2ee >2013-12-04 07:25:07,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40d2c5ae >2013-12-04 07:25:07,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 40d2c5ae >2013-12-04 07:25:07,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 28d414fb >2013-12-04 07:25:08,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@783b6666, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87d97f10}, log id: 28d414fb >2013-12-04 07:25:10,678 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) No up server in cluster >2013-12-04 07:25:10,678 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:25:10,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 631b5c94 >2013-12-04 07:25:11,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, return: [], log id: 631b5c94 >2013-12-04 07:25:13,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5984476f >2013-12-04 07:25:13,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5984476f >2013-12-04 07:25:13,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3dca0a67 >2013-12-04 07:25:14,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd2a7ab6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c32ccd05}, log id: 3dca0a67 >2013-12-04 07:25:19,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50b6159d >2013-12-04 07:25:19,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50b6159d >2013-12-04 07:25:19,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 389f3e7c >2013-12-04 07:25:19,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce70c710, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abc32a72}, log id: 389f3e7c >2013-12-04 07:25:24,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 233ea135 >2013-12-04 07:25:25,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 233ea135 >2013-12-04 07:25:25,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8c69637 >2013-12-04 07:25:25,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d162ffe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bcc7f07}, log id: 8c69637 >2013-12-04 07:25:30,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24975bbe >2013-12-04 07:25:31,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 24975bbe >2013-12-04 07:25:31,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 498f55e9 >2013-12-04 07:25:31,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b6bf596, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3312596}, log id: 498f55e9 >2013-12-04 07:25:36,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d200205 >2013-12-04 07:25:37,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7d200205 >2013-12-04 07:25:37,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6e7ba8f9 >2013-12-04 07:25:37,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4e2137a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9ab427c}, log id: 6e7ba8f9 >2013-12-04 07:25:42,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38f3f3f9 >2013-12-04 07:25:42,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 38f3f3f9 >2013-12-04 07:25:42,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7399b16 >2013-12-04 07:25:43,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@625eec66, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97402dd4}, log id: 7399b16 >2013-12-04 07:25:48,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4963820f >2013-12-04 07:25:48,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4963820f >2013-12-04 07:25:48,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 33c64bad >2013-12-04 07:25:48,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6489222, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baaae3f3}, log id: 33c64bad >2013-12-04 07:25:54,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f4730af >2013-12-04 07:25:54,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f4730af >2013-12-04 07:25:54,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77d25c08 >2013-12-04 07:25:54,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72f2983c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@730269b1}, log id: 77d25c08 >2013-12-04 07:25:59,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 350eda03 >2013-12-04 07:26:00,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 350eda03 >2013-12-04 07:26:00,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12b69e23 >2013-12-04 07:26:00,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0db410, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bb39ae6}, log id: 12b69e23 >2013-12-04 07:26:05,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 703bea5a >2013-12-04 07:26:06,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 703bea5a >2013-12-04 07:26:06,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 62c26d52 >2013-12-04 07:26:06,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce9f92cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b107eebf}, log id: 62c26d52 >2013-12-04 07:26:11,005 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) No up server in cluster >2013-12-04 07:26:11,005 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:26:11,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11395852 >2013-12-04 07:26:11,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterTasksListVDSCommand, return: [], log id: 11395852 >2013-12-04 07:26:11,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58af92b9 >2013-12-04 07:26:11,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58af92b9 >2013-12-04 07:26:11,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 62a4d92d >2013-12-04 07:26:12,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a03c31cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf49e193}, log id: 62a4d92d >2013-12-04 07:26:17,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3e43091c >2013-12-04 07:26:17,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e43091c >2013-12-04 07:26:17,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19f00a85 >2013-12-04 07:26:18,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31c5ff21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bef3b10}, log id: 19f00a85 >2013-12-04 07:26:23,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41dbf2d0 >2013-12-04 07:26:23,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 41dbf2d0 >2013-12-04 07:26:23,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6e508c52 >2013-12-04 07:26:23,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@529fd7bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec2bb52a}, log id: 6e508c52 >2013-12-04 07:26:28,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54a71942 >2013-12-04 07:26:29,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 54a71942 >2013-12-04 07:26:29,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 731fb4ec >2013-12-04 07:26:29,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a98c55b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ca6e9e0}, log id: 731fb4ec >2013-12-04 07:26:34,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 378d853b >2013-12-04 07:26:35,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 378d853b >2013-12-04 07:26:35,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 489b0eb2 >2013-12-04 07:26:35,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fc17c00, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e063b516}, log id: 489b0eb2 >2013-12-04 07:26:40,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 19a581e3 >2013-12-04 07:26:41,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 19a581e3 >2013-12-04 07:26:41,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69a456ef >2013-12-04 07:26:41,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5eeba845, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fe0b0eb}, log id: 69a456ef >2013-12-04 07:26:46,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: f64f354 >2013-12-04 07:26:46,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: f64f354 >2013-12-04 07:26:46,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 58ef4131 >2013-12-04 07:26:47,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76cf95e1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5315b9e}, log id: 58ef4131 >2013-12-04 07:26:52,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 707d74e7 >2013-12-04 07:26:52,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 707d74e7 >2013-12-04 07:26:52,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4a90df09 >2013-12-04 07:26:53,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6ddf5f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba388b0a}, log id: 4a90df09 >2013-12-04 07:26:58,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2559f381 >2013-12-04 07:26:58,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2559f381 >2013-12-04 07:26:58,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: cd3b3bb >2013-12-04 07:26:58,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e368d6e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf8b42fc}, log id: cd3b3bb >2013-12-04 07:27:03,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 581727c9 >2013-12-04 07:27:04,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 581727c9 >2013-12-04 07:27:04,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 183785bd >2013-12-04 07:27:04,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfd0190c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@beaa8ac6}, log id: 183785bd >2013-12-04 07:27:09,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53165511 >2013-12-04 07:27:10,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 53165511 >2013-12-04 07:27:10,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1e88003d >2013-12-04 07:27:10,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@262d78bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f47078f}, log id: 1e88003d >2013-12-04 07:27:11,300 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-04 07:27:11,300 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:27:11,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b916893 >2013-12-04 07:27:11,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2b916893 >2013-12-04 07:27:15,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d4fed55 >2013-12-04 07:27:16,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d4fed55 >2013-12-04 07:27:16,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7691e037 >2013-12-04 07:27:16,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26c87b2e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93fd4f2}, log id: 7691e037 >2013-12-04 07:27:21,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: c5b61a >2013-12-04 07:27:21,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: c5b61a >2013-12-04 07:27:21,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47236a13 >2013-12-04 07:27:22,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ed015f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@996fb883}, log id: 47236a13 >2013-12-04 07:27:27,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70c5c522 >2013-12-04 07:27:27,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 70c5c522 >2013-12-04 07:27:27,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 324b96ca >2013-12-04 07:27:27,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@147f959d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bda04f22}, log id: 324b96ca >2013-12-04 07:27:32,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2acf60f5 >2013-12-04 07:27:33,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 2acf60f5 >2013-12-04 07:27:33,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 9137f20 >2013-12-04 07:27:33,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d61d766, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b20297cb}, log id: 9137f20 >2013-12-04 07:27:38,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 178c7fb4 >2013-12-04 07:27:39,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 178c7fb4 >2013-12-04 07:27:39,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74fc9321 >2013-12-04 07:27:39,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a83d79a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b403f1ad}, log id: 74fc9321 >2013-12-04 07:27:44,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ef2fdc6 >2013-12-04 07:27:45,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ef2fdc6 >2013-12-04 07:27:45,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d87f9d4 >2013-12-04 07:27:45,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b882749d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64d732c1}, log id: 1d87f9d4 >2013-12-04 07:27:50,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a00cfb6 >2013-12-04 07:27:50,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a00cfb6 >2013-12-04 07:27:50,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1436a895 >2013-12-04 07:27:51,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f0237c9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7df0c4ef}, log id: 1436a895 >2013-12-04 07:27:56,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b662099 >2013-12-04 07:27:56,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 3b662099 >2013-12-04 07:27:56,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17973c89 >2013-12-04 07:27:57,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5747e46, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ab2d7f1}, log id: 17973c89 >2013-12-04 07:28:02,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7df89a0e >2013-12-04 07:28:02,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7df89a0e >2013-12-04 07:28:02,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 721f99eb >2013-12-04 07:28:02,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9a8a5af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b305614}, log id: 721f99eb >2013-12-04 07:28:07,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ddb0528 >2013-12-04 07:28:08,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 5ddb0528 >2013-12-04 07:28:08,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c0fe641 >2013-12-04 07:28:08,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b8aaae6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8875d7a}, log id: 4c0fe641 >2013-12-04 07:28:11,604 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-04 07:28:11,604 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:28:11,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7be014ba >2013-12-04 07:28:11,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7be014ba >2013-12-04 07:28:13,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a5fe24 >2013-12-04 07:28:14,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a5fe24 >2013-12-04 07:28:14,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4455257b >2013-12-04 07:28:14,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8a9478b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1c4a2e7}, log id: 4455257b >2013-12-04 07:28:19,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4055e414 >2013-12-04 07:28:20,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 4055e414 >2013-12-04 07:28:20,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5099dbc5 >2013-12-04 07:28:20,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5060a1e4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfe4436}, log id: 5099dbc5 >2013-12-04 07:28:25,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f2342ef >2013-12-04 07:28:25,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f2342ef >2013-12-04 07:28:25,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 649cc63c >2013-12-04 07:28:26,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e84ebd9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1895160d}, log id: 649cc63c >2013-12-04 07:28:31,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ae9660 >2013-12-04 07:28:31,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ae9660 >2013-12-04 07:28:31,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 325382d1 >2013-12-04 07:28:32,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc8f4476, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@544a670b}, log id: 325382d1 >2013-12-04 07:28:37,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 664374f2 >2013-12-04 07:28:37,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 664374f2 >2013-12-04 07:28:37,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 212588b2 >2013-12-04 07:28:37,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0e4f21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c2d7045}, log id: 212588b2 >2013-12-04 07:28:42,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f95f485 >2013-12-04 07:28:43,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 3f95f485 >2013-12-04 07:28:43,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 579c5585 >2013-12-04 07:28:43,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2373242, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b932bb81}, log id: 579c5585 >2013-12-04 07:28:48,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 66acdaa1 >2013-12-04 07:28:49,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 66acdaa1 >2013-12-04 07:28:49,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47197630 >2013-12-04 07:28:49,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb78a284, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d629b46}, log id: 47197630 >2013-12-04 07:28:54,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f16ed7d >2013-12-04 07:28:55,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7f16ed7d >2013-12-04 07:28:55,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7888646f >2013-12-04 07:28:55,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@209f3a56, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47028287}, log id: 7888646f >2013-12-04 07:29:00,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 43b18002 >2013-12-04 07:29:00,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 43b18002 >2013-12-04 07:29:00,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5d36cb1c >2013-12-04 07:29:01,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a56af94b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9f233a0}, log id: 5d36cb1c >2013-12-04 07:29:06,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 691294fd >2013-12-04 07:29:06,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 691294fd >2013-12-04 07:29:06,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53b0c26e >2013-12-04 07:29:07,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fed0c5e3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2f6af3d}, log id: 53b0c26e >2013-12-04 07:29:11,915 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-04 07:29:11,915 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:29:11,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6beca4d9 >2013-12-04 07:29:12,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 243cbadc >2013-12-04 07:29:12,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6beca4d9 >2013-12-04 07:29:12,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 243cbadc >2013-12-04 07:29:12,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a8364ba >2013-12-04 07:29:12,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc8d556, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@350e92aa}, log id: 7a8364ba >2013-12-04 07:29:16,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1ac31d29 >2013-12-04 07:29:17,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@61004b99, log id: 1ac31d29 >2013-12-04 07:29:17,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a635b8f >2013-12-04 07:29:17,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1da66cae, log id: 5a635b8f >2013-12-04 07:29:17,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1b8c2c7d >2013-12-04 07:29:18,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 1b8c2c7d >2013-12-04 07:29:18,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1993f30b >2013-12-04 07:29:18,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce955cd8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30917b1f}, log id: 1993f30b >2013-12-04 07:29:23,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 741cbd46 >2013-12-04 07:29:24,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 741cbd46 >2013-12-04 07:29:24,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: cd59f6c >2013-12-04 07:29:24,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3c24857, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6c6687b}, log id: cd59f6c >2013-12-04 07:29:29,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3bb4a62c >2013-12-04 07:29:30,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bb4a62c >2013-12-04 07:29:30,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c42c306 >2013-12-04 07:29:30,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c87b54a1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@845bcac7}, log id: c42c306 >2013-12-04 07:29:35,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ef9ce4 >2013-12-04 07:29:35,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ef9ce4 >2013-12-04 07:29:35,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ef7d5f7 >2013-12-04 07:29:36,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf76a154, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3a1d6c3}, log id: ef7d5f7 >2013-12-04 07:29:41,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 640f71bc >2013-12-04 07:29:41,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 640f71bc >2013-12-04 07:29:41,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ab3d070 >2013-12-04 07:29:41,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87c6153a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9eca029}, log id: 7ab3d070 >2013-12-04 07:29:46,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6d97d398 >2013-12-04 07:29:47,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d97d398 >2013-12-04 07:29:47,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7246d74 >2013-12-04 07:29:47,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@429167a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30fc8bf6}, log id: 7246d74 >2013-12-04 07:29:52,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 74e9ef14 >2013-12-04 07:29:53,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 74e9ef14 >2013-12-04 07:29:53,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 492cff7c >2013-12-04 07:29:53,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48f93540, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@972b3ef3}, log id: 492cff7c >2013-12-04 07:29:58,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3e512050 >2013-12-04 07:29:59,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e512050 >2013-12-04 07:29:59,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e2a7f22 >2013-12-04 07:29:59,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61952af3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f692d2f}, log id: 4e2a7f22 >2013-12-04 07:30:04,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27132905 >2013-12-04 07:30:04,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 27132905 >2013-12-04 07:30:04,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 369c69d8 >2013-12-04 07:30:05,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@149e5003, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67ed7bb3}, log id: 369c69d8 >2013-12-04 07:30:10,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47d2917 >2013-12-04 07:30:10,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 47d2917 >2013-12-04 07:30:10,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a80ade7 >2013-12-04 07:30:10,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61c7ecfd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@156354de}, log id: 3a80ade7 >2013-12-04 07:30:12,212 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) No up server in cluster >2013-12-04 07:30:12,213 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:30:12,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55c9afcd >2013-12-04 07:30:12,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterTasksListVDSCommand, return: [], log id: 55c9afcd >2013-12-04 07:30:16,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36713744 >2013-12-04 07:30:16,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36713744 >2013-12-04 07:30:16,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18674ea8 >2013-12-04 07:30:16,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f4f04cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d1a01ea}, log id: 18674ea8 >2013-12-04 07:30:21,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f0865ba >2013-12-04 07:30:22,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f0865ba >2013-12-04 07:30:22,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6751df10 >2013-12-04 07:30:22,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f031d2c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba2b3b3c}, log id: 6751df10 >2013-12-04 07:30:27,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 53bdb5e4 >2013-12-04 07:30:28,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53bdb5e4 >2013-12-04 07:30:28,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 77598254 >2013-12-04 07:30:28,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5cb773c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a057160}, log id: 77598254 >2013-12-04 07:30:33,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 56c0043b >2013-12-04 07:30:33,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 56c0043b >2013-12-04 07:30:33,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b0d350f >2013-12-04 07:30:34,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b863254, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@101985f0}, log id: 5b0d350f >2013-12-04 07:30:39,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7d35653 >2013-12-04 07:30:39,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d35653 >2013-12-04 07:30:39,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11adc652 >2013-12-04 07:30:40,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53e44438, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3a13d68}, log id: 11adc652 >2013-12-04 07:30:45,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f3900d1 >2013-12-04 07:30:45,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f3900d1 >2013-12-04 07:30:45,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7145d943 >2013-12-04 07:30:45,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e851b384, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdb18902}, log id: 7145d943 >2013-12-04 07:30:50,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7518b98a >2013-12-04 07:30:51,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7518b98a >2013-12-04 07:30:51,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78d135a3 >2013-12-04 07:30:51,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e9b95b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bd269b6}, log id: 78d135a3 >2013-12-04 07:30:56,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 797b3c0a >2013-12-04 07:30:57,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 797b3c0a >2013-12-04 07:30:57,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3fde6c01 >2013-12-04 07:30:57,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbcf7752, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e95d73e}, log id: 3fde6c01 >2013-12-04 07:31:02,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47f835d7 >2013-12-04 07:31:03,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 47f835d7 >2013-12-04 07:31:03,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3aeb828e >2013-12-04 07:31:03,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4982d9f6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@940dd367}, log id: 3aeb828e >2013-12-04 07:31:08,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10f87e4 >2013-12-04 07:31:08,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 10f87e4 >2013-12-04 07:31:08,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4cf48cc1 >2013-12-04 07:31:09,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfef041c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2f7bfdf}, log id: 4cf48cc1 >2013-12-04 07:31:12,526 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) No up server in cluster >2013-12-04 07:31:12,526 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:31:12,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: de36c48 >2013-12-04 07:31:12,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, return: [], log id: de36c48 >2013-12-04 07:31:14,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 221ac61c >2013-12-04 07:31:14,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 221ac61c >2013-12-04 07:31:14,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 72c7afcf >2013-12-04 07:31:14,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64f4b755, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dff90dd6}, log id: 72c7afcf >2013-12-04 07:31:19,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20f190ed >2013-12-04 07:31:20,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 20f190ed >2013-12-04 07:31:20,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 155c412b >2013-12-04 07:31:20,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49e4467, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1fc5d15}, log id: 155c412b >2013-12-04 07:31:25,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 73320eee >2013-12-04 07:31:26,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 73320eee >2013-12-04 07:31:26,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70cedb36 >2013-12-04 07:31:26,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93675dab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8045aaba}, log id: 70cedb36 >2013-12-04 07:31:31,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 64f13ed9 >2013-12-04 07:31:32,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 64f13ed9 >2013-12-04 07:31:32,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53e96933 >2013-12-04 07:31:32,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75bc656d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf26d2ef}, log id: 53e96933 >2013-12-04 07:31:37,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c27c343 >2013-12-04 07:31:37,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c27c343 >2013-12-04 07:31:37,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ca6885d >2013-12-04 07:31:38,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2f69fa9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71fd55bf}, log id: ca6885d >2013-12-04 07:31:43,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b8eb25c >2013-12-04 07:31:43,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b8eb25c >2013-12-04 07:31:43,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 40b2b5de >2013-12-04 07:31:43,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3726a2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6788216}, log id: 40b2b5de >2013-12-04 07:31:48,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 768b846 >2013-12-04 07:31:49,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 768b846 >2013-12-04 07:31:49,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75e022a3 >2013-12-04 07:31:49,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ba4a55a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92a1899b}, log id: 75e022a3 >2013-12-04 07:31:54,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6cbcb088 >2013-12-04 07:31:55,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cbcb088 >2013-12-04 07:31:55,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ba8f94 >2013-12-04 07:31:55,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2a31ad6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffc88848}, log id: 6ba8f94 >2013-12-04 07:32:00,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 127e4e81 >2013-12-04 07:32:01,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 127e4e81 >2013-12-04 07:32:01,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b955ad >2013-12-04 07:32:01,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3985a06, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2a407e8}, log id: 3b955ad >2013-12-04 07:32:06,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3210dce1 >2013-12-04 07:32:06,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3210dce1 >2013-12-04 07:32:06,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3e3d35a3 >2013-12-04 07:32:07,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d77b91c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b700e01a}, log id: 3e3d35a3 >2013-12-04 07:32:12,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: fe69ef5 >2013-12-04 07:32:12,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: fe69ef5 >2013-12-04 07:32:12,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2667ef3b >2013-12-04 07:32:12,821 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) No up server in cluster >2013-12-04 07:32:12,822 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:32:12,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2ba0943b >2013-12-04 07:32:13,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35b330d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97cbdc0e}, log id: 2667ef3b >2013-12-04 07:32:13,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2ba0943b >2013-12-04 07:32:18,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d722abe >2013-12-04 07:32:18,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d722abe >2013-12-04 07:32:18,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 239afd8c >2013-12-04 07:32:18,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@516aa65c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44fc75b9}, log id: 239afd8c >2013-12-04 07:32:23,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 56b70f33 >2013-12-04 07:32:24,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 56b70f33 >2013-12-04 07:32:24,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 601f83ea >2013-12-04 07:32:24,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ddc0fb7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25484dd3}, log id: 601f83ea >2013-12-04 07:32:29,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 249fec5d >2013-12-04 07:32:30,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 249fec5d >2013-12-04 07:32:30,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 50e25e56 >2013-12-04 07:32:30,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@993b7928, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db62c8a4}, log id: 50e25e56 >2013-12-04 07:32:35,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7bbe1e00 >2013-12-04 07:32:35,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7bbe1e00 >2013-12-04 07:32:35,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6bc12c2d >2013-12-04 07:32:36,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f4e6d0d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57a5f275}, log id: 6bc12c2d >2013-12-04 07:32:41,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 718fa39b >2013-12-04 07:32:41,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 718fa39b >2013-12-04 07:32:41,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6efa8d30 >2013-12-04 07:32:42,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be0ea5cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e024bd7}, log id: 6efa8d30 >2013-12-04 07:32:47,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41f3a7e9 >2013-12-04 07:32:47,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 41f3a7e9 >2013-12-04 07:32:47,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16fba607 >2013-12-04 07:32:47,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f50e31ca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da88a6b8}, log id: 16fba607 >2013-12-04 07:32:52,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 706881a1 >2013-12-04 07:32:53,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 706881a1 >2013-12-04 07:32:53,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 55be9ee8 >2013-12-04 07:32:53,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a191645, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36f02bb5}, log id: 55be9ee8 >2013-12-04 07:32:55,894 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-7) [1e709842] Lock Acquired to object EngineLock [exclusiveLocks= key: be2c16f2-a173-4bac-a979-47cf211a97e3 value: GLUSTER >, sharedLocks= ] >2013-12-04 07:32:55,912 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-7) [1e709842] Running command: StartRemoveGlusterVolumeBricksCommand internal: false. Entities affected : ID: be2c16f2-a173-4bac-a979-47cf211a97e3 Type: GlusterVolume >2013-12-04 07:32:55,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-7) [1e709842] START, StartRemoveGlusterVolumeBricksVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 437494f1 >2013-12-04 07:32:58,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f43a971 >2013-12-04 07:32:59,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, log id: 5f43a971 >2013-12-04 07:32:59,031 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-14) Gluster servers list failed in server host1 moving it to NonOperational >2013-12-04 07:32:59,038 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to fetch gluster peer list from server host1 on Cluster test. >2013-12-04 07:32:59,059 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-14) [220e915] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:32:59,063 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-14) [220e915] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, status=NonOperational, nonOperationalReason=GLUSTER_COMMAND_FAILED), log id: 4020661 >2013-12-04 07:32:59,067 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-14) [220e915] FINISH, SetVdsStatusVDSCommand, log id: 4020661 >2013-12-04 07:32:59,082 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [220e915] Correlation ID: 220e915, Job ID: 1df8ddaa-e287-48ef-96b6-f8f4e10ff868, Call Stack: null, Custom Event ID: -1, Message: Gluster command [gluster peer status] failed on server host1. >2013-12-04 07:32:59,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [220e915] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19e58ee4 >2013-12-04 07:33:01,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [220e915] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 19e58ee4 >2013-12-04 07:33:01,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [220e915] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 50176a9e >2013-12-04 07:33:01,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [220e915] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50176a9e >2013-12-04 07:33:01,858 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [220e915] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to fetch gluster volume list from server host1. >2013-12-04 07:33:01,883 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:33:01,885 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, status=NonOperational, nonOperationalReason=GLUSTER_COMMAND_FAILED), log id: 12caf064 >2013-12-04 07:33:01,890 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, SetVdsStatusVDSCommand, log id: 12caf064 >2013-12-04 07:33:01,907 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [7973d44b] Correlation ID: 7973d44b, Job ID: 9a0568b7-14f1-4b87-b607-61a31aeec3ec, Call Stack: null, Custom Event ID: -1, Message: Gluster command [gluster peer status] failed on server host1. >2013-12-04 07:33:01,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a483f77 >2013-12-04 07:33:02,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e863ee0d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20c03578}, log id: 1a483f77 >2013-12-04 07:33:02,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-7) [1e709842] FINISH, StartRemoveGlusterVolumeBricksVDSCommand, return: org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@baeab78e, log id: 437494f1 >2013-12-04 07:33:02,476 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [1e709842] Correlation ID: 1e709842, Job ID: 71bf747e-b6ad-4d8a-9cae-d0a8ee3cb880, Call Stack: null, Custom Event ID: -1, Message: Started removing bricks from Volume dis_vol >2013-12-04 07:33:07,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6d177155 >2013-12-04 07:33:07,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 6d177155 >2013-12-04 07:33:07,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c271263 >2013-12-04 07:33:08,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6486ca7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c8f5032}, log id: 1c271263 >2013-12-04 07:33:08,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a6893b8 >2013-12-04 07:33:08,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@50843a46, log id: 5a6893b8 >2013-12-04 07:33:09,017 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (ajp-/127.0.0.1:8702-10) Trying to release exclusive lock which does not exist, lock key: be2c16f2-a173-4bac-a979-47cf211a97e3GLUSTER >2013-12-04 07:33:13,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7346dd8 >2013-12-04 07:33:13,125 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) No up server in cluster >2013-12-04 07:33:13,126 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:33:13,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6da084bb >2013-12-04 07:33:13,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 7346dd8 >2013-12-04 07:33:13,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36148ec3 >2013-12-04 07:33:13,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@edfcca13], log id: 6da084bb >2013-12-04 07:33:13,690 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-91) Trying to release exclusive lock which does not exist, lock key: be2c16f2-a173-4bac-a979-47cf211a97e3GLUSTER >2013-12-04 07:33:13,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ad2f346, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f204db41}, log id: 36148ec3 >2013-12-04 07:33:18,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39ecf72c >2013-12-04 07:33:19,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 39ecf72c >2013-12-04 07:33:19,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f72ee6f >2013-12-04 07:33:19,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fd03009, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f245761b}, log id: 3f72ee6f >2013-12-04 07:33:24,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ac3cbe1 >2013-12-04 07:33:25,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:DISCONNECTED], log id: ac3cbe1 >2013-12-04 07:33:25,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3fc58020 >2013-12-04 07:33:25,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2c29395, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9104939c}, log id: 3fc58020 >2013-12-04 07:33:30,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 163234ee >2013-12-04 07:33:31,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 163234ee >2013-12-04 07:33:31,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2033e0aa >2013-12-04 07:33:31,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa6c2ddb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90efee2}, log id: 2033e0aa >2013-12-04 07:33:36,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 58261404 >2013-12-04 07:33:36,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 58261404 >2013-12-04 07:33:36,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 69793fb5 >2013-12-04 07:33:37,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f271a4f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ece79bd8}, log id: 69793fb5 >2013-12-04 07:33:42,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6f9792e >2013-12-04 07:33:42,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 6f9792e >2013-12-04 07:33:42,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4952227f >2013-12-04 07:33:42,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a5f4884, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79e26b74}, log id: 4952227f >2013-12-04 07:33:47,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 35dd5b59 >2013-12-04 07:33:48,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 35dd5b59 >2013-12-04 07:33:48,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ed451bf >2013-12-04 07:33:48,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8d1e4a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d984048}, log id: 3ed451bf >2013-12-04 07:33:53,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63b55db5 >2013-12-04 07:33:54,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 63b55db5 >2013-12-04 07:33:54,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5ea4d41c >2013-12-04 07:33:54,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e97eed1a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41d0463}, log id: 5ea4d41c >2013-12-04 07:33:59,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d042e02 >2013-12-04 07:34:04,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d042e02 >2013-12-04 07:34:04,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 419b172e >2013-12-04 07:34:05,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39539ca0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaad5bca}, log id: 419b172e >2013-12-04 07:34:10,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4e44e1dd >2013-12-04 07:34:10,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e44e1dd >2013-12-04 07:34:10,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 330382d4 >2013-12-04 07:34:11,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@286ce53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5883998}, log id: 330382d4 >2013-12-04 07:34:13,703 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-04 07:34:13,703 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:34:13,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 60ea58d1 >2013-12-04 07:34:14,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 60ea58d1 >2013-12-04 07:34:16,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26120a46 >2013-12-04 07:34:16,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 26120a46 >2013-12-04 07:34:16,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 798fe4bc >2013-12-04 07:34:16,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d22e06be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2ae81ce}, log id: 798fe4bc >2013-12-04 07:34:17,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6845c02c >2013-12-04 07:34:17,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@254a8e9f, log id: 6845c02c >2013-12-04 07:34:17,939 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-75) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected change in status of brick 10.70.37.74:/rhs/brick5/b3 of volume dis_rep_vol from DOWN to UP. >2013-12-04 07:34:17,953 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-75) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected change in status of brick 10.70.37.74:/rhs/brick4/b1 of volume dis_rep_vol from DOWN to UP. >2013-12-04 07:34:17,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 678d08a2 >2013-12-04 07:34:18,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4cf7554c, log id: 678d08a2 >2013-12-04 07:34:18,342 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-75) Error while refreshing brick statuses for volume dis_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:34:22,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40788f48 >2013-12-04 07:34:22,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 40788f48 >2013-12-04 07:34:22,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d915b2e >2013-12-04 07:34:23,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21f33731, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2639ec2}, log id: d915b2e >2013-12-04 07:34:28,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 133f859b >2013-12-04 07:34:28,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 133f859b >2013-12-04 07:34:28,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 72d8f9e3 >2013-12-04 07:34:28,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d931c425, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5d49f08}, log id: 72d8f9e3 >2013-12-04 07:34:33,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7775f75b >2013-12-04 07:34:34,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7775f75b >2013-12-04 07:34:34,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 538b2569 >2013-12-04 07:34:34,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3452dd55, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c696fb3c}, log id: 538b2569 >2013-12-04 07:34:39,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25409f1f >2013-12-04 07:34:40,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25409f1f >2013-12-04 07:34:40,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 473a291d >2013-12-04 07:34:40,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@969c3fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72226e42}, log id: 473a291d >2013-12-04 07:34:45,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1ff71ce3 >2013-12-04 07:34:46,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ff71ce3 >2013-12-04 07:34:46,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39683c84 >2013-12-04 07:34:46,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee3c11af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f6cee45}, log id: 39683c84 >2013-12-04 07:34:51,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 512a09c9 >2013-12-04 07:34:52,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 512a09c9 >2013-12-04 07:34:52,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36fee383 >2013-12-04 07:34:52,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97b5df2f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fd2f7e6}, log id: 36fee383 >2013-12-04 07:34:57,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 77cc84f >2013-12-04 07:34:58,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77cc84f >2013-12-04 07:34:58,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: aeb3087 >2013-12-04 07:34:58,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6238dd02, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d5e86ef}, log id: aeb3087 >2013-12-04 07:35:00,018 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-54) Autorecovering 1 hosts >2013-12-04 07:35:00,071 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-54) Autorecovering hosts id: 4c17e50e-8225-48c6-bcb3-bfba4ec37037, name : host1 >2013-12-04 07:35:00,075 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-54) [60d04fc2] Lock Acquired to object EngineLock [exclusiveLocks= key: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 value: VDS >, sharedLocks= ] >2013-12-04 07:35:00,087 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-54) [60d04fc2] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:35:00,087 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-54) [60d04fc2] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2013-12-04 07:35:00,087 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-54) [60d04fc2] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2013-12-04 07:35:00,093 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-54) [60d04fc2] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, status=Unassigned, nonOperationalReason=NONE), log id: 5d5237d4 >2013-12-04 07:35:00,102 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-54) [60d04fc2] FINISH, SetVdsStatusVDSCommand, log id: 5d5237d4 >2013-12-04 07:35:00,104 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-54) [60d04fc2] START, ActivateVdsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3df8f8a1 >2013-12-04 07:35:00,269 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-54) [60d04fc2] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, vds=Host[host1]), log id: 159f87d1 >2013-12-04 07:35:00,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-54) [60d04fc2] FINISH, GetHardwareInfoVDSCommand, log id: 159f87d1 >2013-12-04 07:35:00,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [60d04fc2] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 48445329 >2013-12-04 07:35:00,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [60d04fc2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 48445329 >2013-12-04 07:35:00,929 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:35:00,931 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 3df8f8a1 >2013-12-04 07:35:01,219 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2013-12-04 07:35:01,297 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] Lock freed to object EngineLock [exclusiveLocks= key: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 value: VDS >, sharedLocks= ] >2013-12-04 07:35:03,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d73b0d1 >2013-12-04 07:35:04,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d73b0d1 >2013-12-04 07:35:04,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56f523eb >2013-12-04 07:35:04,295 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, vds=Host[host1]), log id: 4ea67592 >2013-12-04 07:35:04,342 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GetHardwareInfoVDSCommand, log id: 4ea67592 >2013-12-04 07:35:04,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39d7c81f >2013-12-04 07:35:04,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@111c1c64, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cda2f0ba}, log id: 56f523eb >2013-12-04 07:35:04,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 39d7c81f >2013-12-04 07:35:04,872 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-88) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host host1. >2013-12-04 07:35:04,901 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-88) [5516e841] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 5849b030-626e-47cb-ad90-3ce782d831b3 Type: StoragePool >2013-12-04 07:35:04,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [5516e841] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43b133af >2013-12-04 07:35:05,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [5516e841] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 43b133af >2013-12-04 07:35:05,445 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:35:09,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7afb128b >2013-12-04 07:35:10,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7afb128b >2013-12-04 07:35:10,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b3175b9 >2013-12-04 07:35:10,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b6f06, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19f8ddc0}, log id: 3b3175b9 >2013-12-04 07:35:14,146 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) No up server in cluster >2013-12-04 07:35:14,147 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:35:14,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18598f69 >2013-12-04 07:35:14,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, return: [], log id: 18598f69 >2013-12-04 07:35:15,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 49ae0fad >2013-12-04 07:35:15,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 49ae0fad >2013-12-04 07:35:15,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 400936a9 >2013-12-04 07:35:16,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@867ea13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@299e6c2b}, log id: 400936a9 >2013-12-04 07:35:21,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f69401f >2013-12-04 07:35:21,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f69401f >2013-12-04 07:35:21,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 73e864e1 >2013-12-04 07:35:22,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55130c63, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4197d45}, log id: 73e864e1 >2013-12-04 07:35:27,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1663a51 >2013-12-04 07:35:27,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 1663a51 >2013-12-04 07:35:27,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 471cacbb >2013-12-04 07:35:28,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83c2a5b4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae8a10df}, log id: 471cacbb >2013-12-04 07:35:33,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6d69bc88 >2013-12-04 07:35:33,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d69bc88 >2013-12-04 07:35:33,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f972500 >2013-12-04 07:35:34,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36827809, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ba82742}, log id: 1f972500 >2013-12-04 07:35:39,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11964812 >2013-12-04 07:35:39,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11964812 >2013-12-04 07:35:39,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2493951a >2013-12-04 07:35:40,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fccdb85, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bae7208}, log id: 2493951a >2013-12-04 07:35:45,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b390bb3 >2013-12-04 07:35:45,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b390bb3 >2013-12-04 07:35:45,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68670fac >2013-12-04 07:35:45,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@939eaed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@449f873d}, log id: 68670fac >2013-12-04 07:35:50,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29692716 >2013-12-04 07:35:51,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29692716 >2013-12-04 07:35:51,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3349c919 >2013-12-04 07:35:51,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68c4273e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2df672ab}, log id: 3349c919 >2013-12-04 07:35:56,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c235483 >2013-12-04 07:35:57,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c235483 >2013-12-04 07:35:57,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63b2d389 >2013-12-04 07:35:57,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e6e28b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4acacfdd}, log id: 63b2d389 >2013-12-04 07:36:02,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42130d69 >2013-12-04 07:36:03,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 42130d69 >2013-12-04 07:36:03,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b4909d1 >2013-12-04 07:36:03,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6f4bac9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44211258}, log id: 2b4909d1 >2013-12-04 07:36:08,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 593878e1 >2013-12-04 07:36:09,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 593878e1 >2013-12-04 07:36:09,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1944d653 >2013-12-04 07:36:09,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22fd9fdb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5f3152b}, log id: 1944d653 >2013-12-04 07:36:14,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 757af804 >2013-12-04 07:36:14,491 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) No up server in cluster >2013-12-04 07:36:14,491 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:36:14,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1e7a20d9 >2013-12-04 07:36:14,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1e7a20d9 >2013-12-04 07:36:14,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 757af804 >2013-12-04 07:36:14,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55d82b33 >2013-12-04 07:36:15,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e86c92a4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7bb964e}, log id: 55d82b33 >2013-12-04 07:36:20,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 77f4a214 >2013-12-04 07:36:20,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77f4a214 >2013-12-04 07:36:20,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6133db31 >2013-12-04 07:36:21,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fac4044, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff08c354}, log id: 6133db31 >2013-12-04 07:36:26,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7c9b8e47 >2013-12-04 07:36:26,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c9b8e47 >2013-12-04 07:36:26,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ba0f562 >2013-12-04 07:36:27,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19b4a3f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@353ca937}, log id: 2ba0f562 >2013-12-04 07:36:32,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30a91d90 >2013-12-04 07:36:32,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30a91d90 >2013-12-04 07:36:32,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5c04f454 >2013-12-04 07:36:32,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4a6ed8f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39db6fb}, log id: 5c04f454 >2013-12-04 07:36:37,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4598b01c >2013-12-04 07:36:38,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4598b01c >2013-12-04 07:36:38,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b026f9c >2013-12-04 07:36:38,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf0ec048, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae1eb4fd}, log id: 4b026f9c >2013-12-04 07:36:43,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2abc6be7 >2013-12-04 07:36:44,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2abc6be7 >2013-12-04 07:36:44,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d941ab2 >2013-12-04 07:36:44,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@738854d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c590592d}, log id: d941ab2 >2013-12-04 07:36:49,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4034eab >2013-12-04 07:36:50,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4034eab >2013-12-04 07:36:50,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d799e63 >2013-12-04 07:36:50,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e93dd5fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c36e303}, log id: 2d799e63 >2013-12-04 07:36:55,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4bf3c4e8 >2013-12-04 07:36:56,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 4bf3c4e8 >2013-12-04 07:36:56,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a21459c >2013-12-04 07:36:56,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f49eb9fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a354c90}, log id: 6a21459c >2013-12-04 07:37:01,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4fd6d4a5 >2013-12-04 07:37:01,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4fd6d4a5 >2013-12-04 07:37:01,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 383b2dce >2013-12-04 07:37:02,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2150a4ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a62f3c7e}, log id: 383b2dce >2013-12-04 07:37:07,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 77fd5f2b >2013-12-04 07:37:07,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 77fd5f2b >2013-12-04 07:37:07,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1207e8b0 >2013-12-04 07:37:08,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a76a5744, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afaa5cdd}, log id: 1207e8b0 >2013-12-04 07:37:13,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d38bdd1 >2013-12-04 07:37:13,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d38bdd1 >2013-12-04 07:37:13,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6bd50e95 >2013-12-04 07:37:13,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13c02a4a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bb5f4fc}, log id: 6bd50e95 >2013-12-04 07:37:14,916 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) [6dd5dead] No up server in cluster >2013-12-04 07:37:14,916 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) [6dd5dead] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:37:14,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 857e74 >2013-12-04 07:37:15,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterTasksListVDSCommand, return: [], log id: 857e74 >2013-12-04 07:37:18,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 322e8d35 >2013-12-04 07:37:19,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 322e8d35 >2013-12-04 07:37:19,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19990a1a >2013-12-04 07:37:19,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4855124, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8308633}, log id: 19990a1a >2013-12-04 07:37:24,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 30fe4bcc >2013-12-04 07:37:25,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 30fe4bcc >2013-12-04 07:37:25,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b4d445 >2013-12-04 07:37:25,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c8a4e96, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e00fb6d1}, log id: b4d445 >2013-12-04 07:37:30,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 493c99f0 >2013-12-04 07:37:31,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 493c99f0 >2013-12-04 07:37:31,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32f863a0 >2013-12-04 07:37:31,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db219b4a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9c2a69d}, log id: 32f863a0 >2013-12-04 07:37:36,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 176dc59 >2013-12-04 07:37:37,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 176dc59 >2013-12-04 07:37:37,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57613368 >2013-12-04 07:37:37,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf9e6b72, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46f777c}, log id: 57613368 >2013-12-04 07:37:42,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 607988c4 >2013-12-04 07:37:42,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 607988c4 >2013-12-04 07:37:42,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69504193 >2013-12-04 07:37:43,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9217c670, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dba93027}, log id: 69504193 >2013-12-04 07:37:48,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 414365c >2013-12-04 07:37:48,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 414365c >2013-12-04 07:37:48,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7cd1ce5c >2013-12-04 07:37:49,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc9ca8ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f758f89}, log id: 7cd1ce5c >2013-12-04 07:37:54,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 74c6ebbc >2013-12-04 07:37:54,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 74c6ebbc >2013-12-04 07:37:54,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2a9f77c7 >2013-12-04 07:37:54,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8531cbd3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48edb5a8}, log id: 2a9f77c7 >2013-12-04 07:37:59,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11788820 >2013-12-04 07:38:00,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11788820 >2013-12-04 07:38:00,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76f62c36 >2013-12-04 07:38:00,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b635c108, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37a432f3}, log id: 76f62c36 >2013-12-04 07:38:05,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7417243c >2013-12-04 07:38:06,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7417243c >2013-12-04 07:38:06,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c0c50d >2013-12-04 07:38:06,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b496bd2b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1523d136}, log id: 5c0c50d >2013-12-04 07:38:11,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [44971035] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41357282 >2013-12-04 07:38:12,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [44971035] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41357282 >2013-12-04 07:38:12,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [44971035] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 233d6d75 >2013-12-04 07:38:12,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [44971035] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dad7cd7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c18deaf4}, log id: 233d6d75 >2013-12-04 07:38:15,242 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2013-12-04 07:38:15,242 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:38:15,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 21cc4d91 >2013-12-04 07:38:15,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 21cc4d91 >2013-12-04 07:38:17,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2ec0a21a >2013-12-04 07:38:18,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 2ec0a21a >2013-12-04 07:38:18,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38e82f89 >2013-12-04 07:38:18,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3855c53d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ea81e17}, log id: 38e82f89 >2013-12-04 07:38:23,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 51d7e66c >2013-12-04 07:38:23,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51d7e66c >2013-12-04 07:38:23,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6dd19d01 >2013-12-04 07:38:24,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a7935cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e32c21f1}, log id: 6dd19d01 >2013-12-04 07:38:29,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79f2192d >2013-12-04 07:38:29,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 79f2192d >2013-12-04 07:38:29,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43ec9cb3 >2013-12-04 07:38:30,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7b4cec6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82b13333}, log id: 43ec9cb3 >2013-12-04 07:38:35,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47a2a2cf >2013-12-04 07:38:35,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 47a2a2cf >2013-12-04 07:38:35,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4ca8d11c >2013-12-04 07:38:35,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30a753c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@287462b6}, log id: 4ca8d11c >2013-12-04 07:38:36,758 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VMs/Templates Ovf. >2013-12-04 07:38:36,939 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-99) Start refreshing all users data >2013-12-04 07:38:40,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4e9b4c9a >2013-12-04 07:38:41,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e9b4c9a >2013-12-04 07:38:41,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e91640d >2013-12-04 07:38:41,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcfdb48b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75a44d03}, log id: 3e91640d >2013-12-04 07:38:46,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68ebd760 >2013-12-04 07:38:47,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 68ebd760 >2013-12-04 07:38:47,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 46dc623 >2013-12-04 07:38:47,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b4fe198, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2d6c837}, log id: 46dc623 >2013-12-04 07:38:52,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63956345 >2013-12-04 07:38:53,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63956345 >2013-12-04 07:38:53,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15486ee3 >2013-12-04 07:38:53,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@126f3b60, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6896083}, log id: 15486ee3 >2013-12-04 07:38:58,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 139e63d3 >2013-12-04 07:38:59,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 139e63d3 >2013-12-04 07:38:59,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5fdd7062 >2013-12-04 07:38:59,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f20e2b0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@153c1bbb}, log id: 5fdd7062 >2013-12-04 07:39:04,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: e930231 >2013-12-04 07:39:05,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: e930231 >2013-12-04 07:39:05,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 55e22bcf >2013-12-04 07:39:05,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8073848b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33f1740e}, log id: 55e22bcf >2013-12-04 07:39:10,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 298fb228 >2013-12-04 07:39:10,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 298fb228 >2013-12-04 07:39:10,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68935584 >2013-12-04 07:39:11,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0281343, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7960674}, log id: 68935584 >2013-12-04 07:39:15,587 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) No up server in cluster >2013-12-04 07:39:15,587 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:39:15,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 91e0d92 >2013-12-04 07:39:15,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, return: [], log id: 91e0d92 >2013-12-04 07:39:16,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4110a28e >2013-12-04 07:39:16,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 4110a28e >2013-12-04 07:39:16,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2f0b4fe0 >2013-12-04 07:39:17,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b5065dc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1519c6e3}, log id: 2f0b4fe0 >2013-12-04 07:39:18,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fc5f8eb >2013-12-04 07:39:18,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7383e324, log id: 2fc5f8eb >2013-12-04 07:39:18,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 57b58bbb >2013-12-04 07:39:18,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@62846f6f, log id: 57b58bbb >2013-12-04 07:39:18,981 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-35) Error while refreshing brick statuses for volume dis_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:39:22,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 611dcf8c >2013-12-04 07:39:22,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 611dcf8c >2013-12-04 07:39:22,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f49840f >2013-12-04 07:39:22,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c2085ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20e027df}, log id: 7f49840f >2013-12-04 07:39:27,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 66aa1819 >2013-12-04 07:39:28,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 66aa1819 >2013-12-04 07:39:28,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36df49b3 >2013-12-04 07:39:28,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74d4d9c7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@797e169f}, log id: 36df49b3 >2013-12-04 07:39:33,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 282aa861 >2013-12-04 07:39:34,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 282aa861 >2013-12-04 07:39:34,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2031ee3 >2013-12-04 07:39:34,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@483afb7b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44d6ffc7}, log id: 2031ee3 >2013-12-04 07:39:39,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 24749a6c >2013-12-04 07:39:40,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 24749a6c >2013-12-04 07:39:40,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 23337dda >2013-12-04 07:39:40,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56f96df6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ff47b1b}, log id: 23337dda >2013-12-04 07:39:45,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7af67ed2 >2013-12-04 07:39:45,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7af67ed2 >2013-12-04 07:39:45,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 71e48871 >2013-12-04 07:39:46,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e94f0e7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@911d9760}, log id: 71e48871 >2013-12-04 07:39:51,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6301af08 >2013-12-04 07:39:51,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6301af08 >2013-12-04 07:39:51,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4af6f0b6 >2013-12-04 07:39:52,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@482981a5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3197932}, log id: 4af6f0b6 >2013-12-04 07:39:57,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38aeb45b >2013-12-04 07:39:57,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 38aeb45b >2013-12-04 07:39:57,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d5d50e0 >2013-12-04 07:39:57,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f3ece81, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65ad5aa9}, log id: 4d5d50e0 >2013-12-04 07:40:02,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7cb4a109 >2013-12-04 07:40:03,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7cb4a109 >2013-12-04 07:40:03,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1bdd88ee >2013-12-04 07:40:03,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ad8d339, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad572b4b}, log id: 1bdd88ee >2013-12-04 07:40:08,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 309b62e3 >2013-12-04 07:40:09,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 309b62e3 >2013-12-04 07:40:09,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73bb2fd0 >2013-12-04 07:40:09,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b79eac4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a5991b2}, log id: 73bb2fd0 >2013-12-04 07:40:14,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 44bbe52c >2013-12-04 07:40:15,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44bbe52c >2013-12-04 07:40:15,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ce9dc5a >2013-12-04 07:40:15,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2adc8202, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf14ac9}, log id: 7ce9dc5a >2013-12-04 07:40:15,908 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-38) No up server in cluster >2013-12-04 07:40:15,908 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-38) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:40:15,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e4c9669 >2013-12-04 07:40:16,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7e4c9669 >2013-12-04 07:40:20,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63c35239 >2013-12-04 07:40:20,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 63c35239 >2013-12-04 07:40:20,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41444c11 >2013-12-04 07:40:21,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4abf1470, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e07b259c}, log id: 41444c11 >2013-12-04 07:40:26,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2bb8be31 >2013-12-04 07:40:26,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 2bb8be31 >2013-12-04 07:40:26,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 25fac72f >2013-12-04 07:40:26,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2486cbc3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d517e6a5}, log id: 25fac72f >2013-12-04 07:40:32,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2417ca58 >2013-12-04 07:40:32,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 2417ca58 >2013-12-04 07:40:32,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 75795a15 >2013-12-04 07:40:32,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47027a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@200bc617}, log id: 75795a15 >2013-12-04 07:40:37,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2993227 >2013-12-04 07:40:38,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2993227 >2013-12-04 07:40:38,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 177a5948 >2013-12-04 07:40:38,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be35809e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc8b3d}, log id: 177a5948 >2013-12-04 07:40:43,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7afd7a16 >2013-12-04 07:40:44,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7afd7a16 >2013-12-04 07:40:44,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 51ac290f >2013-12-04 07:40:44,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eddf2851, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fddfc1}, log id: 51ac290f >2013-12-04 07:40:49,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34e00bea >2013-12-04 07:40:49,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 34e00bea >2013-12-04 07:40:49,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4454e19a >2013-12-04 07:40:50,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95fe5f2f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b1f797a}, log id: 4454e19a >2013-12-04 07:40:55,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 60b618f0 >2013-12-04 07:40:55,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 60b618f0 >2013-12-04 07:40:55,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 13a4a88c >2013-12-04 07:40:56,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baa3c2e2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a56067fc}, log id: 13a4a88c >2013-12-04 07:41:01,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ac9d7d0 >2013-12-04 07:41:01,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ac9d7d0 >2013-12-04 07:41:01,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 255f26 >2013-12-04 07:41:01,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38c61ef4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65d980dc}, log id: 255f26 >2013-12-04 07:41:06,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3ec97800 >2013-12-04 07:41:07,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ec97800 >2013-12-04 07:41:07,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d4cc294 >2013-12-04 07:41:07,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d2998ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b314a4c5}, log id: 2d4cc294 >2013-12-04 07:41:12,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 294fae56 >2013-12-04 07:41:13,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 294fae56 >2013-12-04 07:41:13,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b9051be >2013-12-04 07:41:13,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6ef3732, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2441b7d9}, log id: 1b9051be >2013-12-04 07:41:16,223 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-38) No up server in cluster >2013-12-04 07:41:16,223 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-38) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:41:16,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70162056 >2013-12-04 07:41:16,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterTasksListVDSCommand, return: [], log id: 70162056 >2013-12-04 07:41:18,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ddea8dd >2013-12-04 07:41:18,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 4ddea8dd >2013-12-04 07:41:18,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5a4eeb9 >2013-12-04 07:41:19,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28e2fdb5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f164e3}, log id: 5a4eeb9 >2013-12-04 07:41:24,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 432cc71d >2013-12-04 07:41:24,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 432cc71d >2013-12-04 07:41:24,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 126c1e00 >2013-12-04 07:41:25,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0b7f6a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f879353f}, log id: 126c1e00 >2013-12-04 07:41:30,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: b263284 >2013-12-04 07:41:30,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b263284 >2013-12-04 07:41:30,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6502317d >2013-12-04 07:41:30,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce7c155f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20e351cf}, log id: 6502317d >2013-12-04 07:41:35,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a933aae >2013-12-04 07:41:36,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a933aae >2013-12-04 07:41:36,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 42f23fd5 >2013-12-04 07:41:36,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4763b317, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd6a1f26}, log id: 42f23fd5 >2013-12-04 07:41:41,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 87fdffb >2013-12-04 07:41:42,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 87fdffb >2013-12-04 07:41:42,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4faeae14 >2013-12-04 07:41:42,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@915f7940, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed741398}, log id: 4faeae14 >2013-12-04 07:41:47,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 315a2a55 >2013-12-04 07:41:48,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 315a2a55 >2013-12-04 07:41:48,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6560e037 >2013-12-04 07:41:48,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a12ff07, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d03cf36}, log id: 6560e037 >2013-12-04 07:41:53,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4930919e >2013-12-04 07:41:53,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4930919e >2013-12-04 07:41:53,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 27c36082 >2013-12-04 07:41:54,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c780e43, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7d44ec9}, log id: 27c36082 >2013-12-04 07:41:59,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 796a2909 >2013-12-04 07:41:59,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 796a2909 >2013-12-04 07:41:59,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 12aba24c >2013-12-04 07:41:59,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67489bf4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3c140bf}, log id: 12aba24c >2013-12-04 07:42:05,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ef6e31c >2013-12-04 07:42:05,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ef6e31c >2013-12-04 07:42:05,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19699f3d >2013-12-04 07:42:05,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4a84363, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3241fbdd}, log id: 19699f3d >2013-12-04 07:42:10,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 17d13f41 >2013-12-04 07:42:11,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 17d13f41 >2013-12-04 07:42:11,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c153dd3 >2013-12-04 07:42:11,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@596046c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2486d5b9}, log id: 3c153dd3 >2013-12-04 07:42:16,538 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-04 07:42:16,538 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:42:16,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27bea44 >2013-12-04 07:42:16,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6b5b0621 >2013-12-04 07:42:16,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 27bea44 >2013-12-04 07:42:17,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 6b5b0621 >2013-12-04 07:42:17,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 241872b1 >2013-12-04 07:42:17,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5cd33ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97769ea1}, log id: 241872b1 >2013-12-04 07:42:22,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 76aaf672 >2013-12-04 07:42:23,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 76aaf672 >2013-12-04 07:42:23,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3237c32d >2013-12-04 07:42:23,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e5f63a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74457f69}, log id: 3237c32d >2013-12-04 07:42:28,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32527bda >2013-12-04 07:42:29,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32527bda >2013-12-04 07:42:29,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5cabc905 >2013-12-04 07:42:29,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc845430, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c575f3b5}, log id: 5cabc905 >2013-12-04 07:42:34,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20882a14 >2013-12-04 07:42:34,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 20882a14 >2013-12-04 07:42:34,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f570bf5 >2013-12-04 07:42:35,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc4d50fa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b87b05f}, log id: 7f570bf5 >2013-12-04 07:42:40,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5dbd8efa >2013-12-04 07:42:40,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5dbd8efa >2013-12-04 07:42:40,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 275dbc24 >2013-12-04 07:42:40,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@125ef957, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0982738}, log id: 275dbc24 >2013-12-04 07:42:46,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 166db4b4 >2013-12-04 07:42:46,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 166db4b4 >2013-12-04 07:42:46,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 332603a5 >2013-12-04 07:42:46,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cd131c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdcfe87a}, log id: 332603a5 >2013-12-04 07:42:51,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 49beddbe >2013-12-04 07:42:52,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 49beddbe >2013-12-04 07:42:52,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68e5fa63 >2013-12-04 07:42:52,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca71beab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8195a9fe}, log id: 68e5fa63 >2013-12-04 07:42:57,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 629abf6f >2013-12-04 07:42:58,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 629abf6f >2013-12-04 07:42:58,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 709da6ed >2013-12-04 07:42:58,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff8ce7f4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9568800}, log id: 709da6ed >2013-12-04 07:43:03,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b056193 >2013-12-04 07:43:03,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b056193 >2013-12-04 07:43:03,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5598d71 >2013-12-04 07:43:04,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92578c28, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34cac58f}, log id: 5598d71 >2013-12-04 07:43:09,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 26d41c5f >2013-12-04 07:43:09,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26d41c5f >2013-12-04 07:43:09,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30f1f76c >2013-12-04 07:43:10,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce5dd4c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e774a137}, log id: 30f1f76c >2013-12-04 07:43:15,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 377d2a4f >2013-12-04 07:43:15,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 377d2a4f >2013-12-04 07:43:15,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d10ce6f >2013-12-04 07:43:15,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b040e947, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af2a327}, log id: 5d10ce6f >2013-12-04 07:43:16,909 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-04 07:43:16,909 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:43:16,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f5fe713 >2013-12-04 07:43:17,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f5fe713 >2013-12-04 07:43:20,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8074618 >2013-12-04 07:43:21,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8074618 >2013-12-04 07:43:21,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39d51af7 >2013-12-04 07:43:21,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2687074e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec108569}, log id: 39d51af7 >2013-12-04 07:43:26,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35f677d9 >2013-12-04 07:43:27,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35f677d9 >2013-12-04 07:43:27,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b3a7e0 >2013-12-04 07:43:27,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@625c62da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3224c1e0}, log id: 7b3a7e0 >2013-12-04 07:43:32,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6fe635cf >2013-12-04 07:43:33,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 6fe635cf >2013-12-04 07:43:33,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c75f1e3 >2013-12-04 07:43:33,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7f3cf13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b84ab85f}, log id: 2c75f1e3 >2013-12-04 07:43:38,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27c1db8d >2013-12-04 07:43:38,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 27c1db8d >2013-12-04 07:43:38,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3830947b >2013-12-04 07:43:39,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34b9e92f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3806c981}, log id: 3830947b >2013-12-04 07:43:44,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6004ac42 >2013-12-04 07:43:44,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6004ac42 >2013-12-04 07:43:44,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 8dbb040 >2013-12-04 07:43:44,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fca928ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a159d122}, log id: 8dbb040 >2013-12-04 07:43:49,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f415f67 >2013-12-04 07:43:50,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f415f67 >2013-12-04 07:43:50,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 242d9aac >2013-12-04 07:43:50,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce120977, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e844913e}, log id: 242d9aac >2013-12-04 07:43:55,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21956747 >2013-12-04 07:43:56,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 21956747 >2013-12-04 07:43:56,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 245c24a8 >2013-12-04 07:43:56,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cd5b03a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf9ad2b5}, log id: 245c24a8 >2013-12-04 07:44:01,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7956d84b >2013-12-04 07:44:02,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7956d84b >2013-12-04 07:44:02,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 598903af >2013-12-04 07:44:02,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@707b71dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bcd7b20}, log id: 598903af >2013-12-04 07:44:07,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39b1e886 >2013-12-04 07:44:07,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 39b1e886 >2013-12-04 07:44:07,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 538088c8 >2013-12-04 07:44:08,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24151532, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@326ed828}, log id: 538088c8 >2013-12-04 07:44:13,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35331737 >2013-12-04 07:44:13,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35331737 >2013-12-04 07:44:13,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 62591f79 >2013-12-04 07:44:14,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c79fc0fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce7e37f6}, log id: 62591f79 >2013-12-04 07:44:17,196 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) No up server in cluster >2013-12-04 07:44:17,196 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:44:17,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6b6c954c >2013-12-04 07:44:17,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6b6c954c >2013-12-04 07:44:19,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48eea329 >2013-12-04 07:44:19,052 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-45) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 07:44:19,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1e7a5a8b, log id: 48eea329 >2013-12-04 07:44:19,337 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-21) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 07:44:19,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 72ce6b4e >2013-12-04 07:44:19,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 72ce6b4e >2013-12-04 07:44:19,867 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-21) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 07:44:19,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70e68b98 >2013-12-04 07:44:20,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e21e6795, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d349679}, log id: 70e68b98 >2013-12-04 07:44:20,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29da4d3b >2013-12-04 07:44:20,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@58a79f8f, log id: 29da4d3b >2013-12-04 07:44:20,449 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-21) Error while refreshing brick statuses for volume dis_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:44:25,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f2c7a17 >2013-12-04 07:44:25,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 3f2c7a17 >2013-12-04 07:44:25,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3198932b >2013-12-04 07:44:25,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95b72dda, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a65e7cb}, log id: 3198932b >2013-12-04 07:44:30,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1beaa692 >2013-12-04 07:44:31,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 1beaa692 >2013-12-04 07:44:31,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70350609 >2013-12-04 07:44:31,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28f53889, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ab48b37}, log id: 70350609 >2013-12-04 07:44:36,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7660cd13 >2013-12-04 07:44:37,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7660cd13 >2013-12-04 07:44:37,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: b712191 >2013-12-04 07:44:37,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce06a1ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfeb5bfe}, log id: b712191 >2013-12-04 07:44:42,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5764666c >2013-12-04 07:44:43,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5764666c >2013-12-04 07:44:43,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 352f8875 >2013-12-04 07:44:43,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2d35d1d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8636ddf}, log id: 352f8875 >2013-12-04 07:44:48,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e42e4ab >2013-12-04 07:44:48,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e42e4ab >2013-12-04 07:44:48,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 65ef5f0b >2013-12-04 07:44:49,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a7dce13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69352d92}, log id: 65ef5f0b >2013-12-04 07:44:54,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36c8a16d >2013-12-04 07:44:54,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 36c8a16d >2013-12-04 07:44:54,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 614a09a >2013-12-04 07:44:55,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38a748ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d6fd9d3}, log id: 614a09a >2013-12-04 07:45:00,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: d48e584 >2013-12-04 07:45:00,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: d48e584 >2013-12-04 07:45:00,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ad81e07 >2013-12-04 07:45:00,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cef7c39, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7d778c1}, log id: 7ad81e07 >2013-12-04 07:45:05,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3044abd7 >2013-12-04 07:45:06,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 3044abd7 >2013-12-04 07:45:06,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 37ffd308 >2013-12-04 07:45:06,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c52be07f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b73e606c}, log id: 37ffd308 >2013-12-04 07:45:11,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: a8ae935 >2013-12-04 07:45:12,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: a8ae935 >2013-12-04 07:45:12,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5adb8664 >2013-12-04 07:45:12,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f9e6deb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6da4b9cb}, log id: 5adb8664 >2013-12-04 07:45:17,504 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) No up server in cluster >2013-12-04 07:45:17,504 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:45:17,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5dd68658 >2013-12-04 07:45:17,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41c8e504 >2013-12-04 07:45:17,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5dd68658 >2013-12-04 07:45:18,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41c8e504 >2013-12-04 07:45:18,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2fd138e7 >2013-12-04 07:45:18,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e6387af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64050d1a}, log id: 2fd138e7 >2013-12-04 07:45:23,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 60ee9170 >2013-12-04 07:45:23,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 60ee9170 >2013-12-04 07:45:23,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 218f1fde >2013-12-04 07:45:24,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a1d0357, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bc02107}, log id: 218f1fde >2013-12-04 07:45:29,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a880870 >2013-12-04 07:45:29,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a880870 >2013-12-04 07:45:29,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5ecbb867 >2013-12-04 07:45:29,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@736820bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc353d88}, log id: 5ecbb867 >2013-12-04 07:45:35,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 715829c7 >2013-12-04 07:45:35,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 715829c7 >2013-12-04 07:45:35,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b714514 >2013-12-04 07:45:35,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a36e2f86, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6396bd8}, log id: 3b714514 >2013-12-04 07:45:40,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42e7520a >2013-12-04 07:45:41,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 42e7520a >2013-12-04 07:45:41,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39ed1b7f >2013-12-04 07:45:41,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e4d8d0d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c57cd43d}, log id: 39ed1b7f >2013-12-04 07:45:46,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 28dbfa49 >2013-12-04 07:45:47,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 28dbfa49 >2013-12-04 07:45:47,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 76cbeee >2013-12-04 07:45:47,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37c65d92, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@219485b5}, log id: 76cbeee >2013-12-04 07:45:52,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6022df3c >2013-12-04 07:45:52,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 6022df3c >2013-12-04 07:45:52,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18ee5d37 >2013-12-04 07:45:53,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f36b2c23, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85bd622}, log id: 18ee5d37 >2013-12-04 07:45:58,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7aa55331 >2013-12-04 07:45:58,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7aa55331 >2013-12-04 07:45:58,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 117bb363 >2013-12-04 07:45:58,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fc46775, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95911a42}, log id: 117bb363 >2013-12-04 07:46:04,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7c0c081a >2013-12-04 07:46:04,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c0c081a >2013-12-04 07:46:04,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79796348 >2013-12-04 07:46:04,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@689497c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5be1706}, log id: 79796348 >2013-12-04 07:46:09,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 62de3eea >2013-12-04 07:46:10,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 62de3eea >2013-12-04 07:46:10,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5664b5b8 >2013-12-04 07:46:10,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98e2f71b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bde5ce7f}, log id: 5664b5b8 >2013-12-04 07:46:15,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ba4b6d1 >2013-12-04 07:46:16,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ba4b6d1 >2013-12-04 07:46:16,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57b2e11c >2013-12-04 07:46:16,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f84a460, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba700b}, log id: 57b2e11c >2013-12-04 07:46:17,827 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) No up server in cluster >2013-12-04 07:46:17,827 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:46:17,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3c0a3359 >2013-12-04 07:46:18,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3c0a3359 >2013-12-04 07:46:21,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d5b8ab6 >2013-12-04 07:46:21,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: d5b8ab6 >2013-12-04 07:46:21,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7eb2cab >2013-12-04 07:46:22,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15fbef41, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44d17b25}, log id: 7eb2cab >2013-12-04 07:46:27,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6f4e3821 >2013-12-04 07:46:27,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f4e3821 >2013-12-04 07:46:27,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 82244a8 >2013-12-04 07:46:28,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c33937d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@247b5f0d}, log id: 82244a8 >2013-12-04 07:46:33,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6519139b >2013-12-04 07:46:33,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6519139b >2013-12-04 07:46:33,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20c4297f >2013-12-04 07:46:33,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7af6d28, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6a9ec4b}, log id: 20c4297f >2013-12-04 07:46:38,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12433ed2 >2013-12-04 07:46:39,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 12433ed2 >2013-12-04 07:46:39,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 323b8c24 >2013-12-04 07:46:39,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbfaa1c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbf6384e}, log id: 323b8c24 >2013-12-04 07:46:44,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2446ae36 >2013-12-04 07:46:45,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2446ae36 >2013-12-04 07:46:45,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 666c6cd3 >2013-12-04 07:46:45,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55be8619, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92f9a592}, log id: 666c6cd3 >2013-12-04 07:46:50,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: e93ffd6 >2013-12-04 07:46:51,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: e93ffd6 >2013-12-04 07:46:51,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4235f28b >2013-12-04 07:46:51,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50439b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c32b13b}, log id: 4235f28b >2013-12-04 07:46:56,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2304f345 >2013-12-04 07:46:56,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 2304f345 >2013-12-04 07:46:56,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7b296365 >2013-12-04 07:46:57,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@465530d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1d5a4ab}, log id: 7b296365 >2013-12-04 07:47:02,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [44971035] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 272c72fe >2013-12-04 07:47:02,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [44971035] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 272c72fe >2013-12-04 07:47:02,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [44971035] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d0076e6 >2013-12-04 07:47:03,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [44971035] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac39584a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db78e227}, log id: 6d0076e6 >2013-12-04 07:47:08,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d88ef97 >2013-12-04 07:47:08,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d88ef97 >2013-12-04 07:47:08,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: b9249ab >2013-12-04 07:47:08,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fae9b9c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd8ea0a7}, log id: b9249ab >2013-12-04 07:47:14,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: bb66e62 >2013-12-04 07:47:14,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:DISCONNECTED], log id: bb66e62 >2013-12-04 07:47:14,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14ae7103 >2013-12-04 07:47:14,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e94961a0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ae999a3}, log id: 14ae7103 >2013-12-04 07:47:18,129 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-04 07:47:18,129 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:47:18,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 106a112a >2013-12-04 07:47:18,217 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-15) [17752854] Lock Acquired to object EngineLock [exclusiveLocks= key: dbfbcab7-6ec2-4bed-89de-aef7e409e97c value: GLUSTER >, sharedLocks= ] >2013-12-04 07:47:18,227 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-15) [17752854] Running command: StartRemoveGlusterVolumeBricksCommand internal: false. Entities affected : ID: dbfbcab7-6ec2-4bed-89de-aef7e409e97c Type: GlusterVolume >2013-12-04 07:47:18,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-15) [17752854] START, StartRemoveGlusterVolumeBricksVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 98bbf46 >2013-12-04 07:47:18,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-15) [17752854] FINISH, StartRemoveGlusterVolumeBricksVDSCommand, return: org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@67e12cdf, log id: 98bbf46 >2013-12-04 07:47:18,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@43c28313], log id: 106a112a >2013-12-04 07:47:19,018 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-15) [17752854] Correlation ID: 17752854, Job ID: 6858aac7-3590-428b-bb6f-80ab01bc5d12, Call Stack: null, Custom Event ID: -1, Message: Could not start remove bricks from Volume dis_rep_vol >2013-12-04 07:47:19,024 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-15) [17752854] Lock freed to object EngineLock [exclusiveLocks= key: dbfbcab7-6ec2-4bed-89de-aef7e409e97c value: GLUSTER >, sharedLocks= ] >2013-12-04 07:47:19,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1084735f >2013-12-04 07:47:20,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 1084735f >2013-12-04 07:47:20,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 65a49242 >2013-12-04 07:47:20,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6139135, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bc71721}, log id: 65a49242 >2013-12-04 07:47:25,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9f1793b >2013-12-04 07:47:26,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 9f1793b >2013-12-04 07:47:26,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b1e7fb2 >2013-12-04 07:47:26,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61fd0b70, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@486e0010}, log id: 6b1e7fb2 >2013-12-04 07:47:31,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b28e17b >2013-12-04 07:47:31,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-8) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3392475d >2013-12-04 07:47:31,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-8) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@39927612, log id: 3392475d >2013-12-04 07:47:32,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 2b28e17b >2013-12-04 07:47:32,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 220490a4 >2013-12-04 07:47:32,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c823525d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6a96b12}, log id: 220490a4 >2013-12-04 07:47:37,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3da81dbc >2013-12-04 07:47:37,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 3da81dbc >2013-12-04 07:47:37,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d4bc4a9 >2013-12-04 07:47:38,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9b31d4f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10b14e4b}, log id: 3d4bc4a9 >2013-12-04 07:47:43,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7531e85c >2013-12-04 07:47:43,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, log id: 7531e85c >2013-12-04 07:47:43,379 INFO [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-78) Gluster servers list failed in server host1 moving it to NonOperational >2013-12-04 07:47:43,386 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-78) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to fetch gluster peer list from server host1 on Cluster test. >2013-12-04 07:47:43,410 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-78) [7c7015fa] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:47:43,413 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-78) [7c7015fa] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, status=NonOperational, nonOperationalReason=GLUSTER_COMMAND_FAILED), log id: 26def600 >2013-12-04 07:47:43,418 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-78) [7c7015fa] FINISH, SetVdsStatusVDSCommand, log id: 26def600 >2013-12-04 07:47:43,433 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-78) [7c7015fa] Correlation ID: 7c7015fa, Job ID: 7909507a-c602-4dd7-bb0b-d262b710829e, Call Stack: null, Custom Event ID: -1, Message: Gluster command [gluster peer status] failed on server host1. >2013-12-04 07:47:43,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [7c7015fa] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79dccd4e >2013-12-04 07:47:43,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [7c7015fa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 79dccd4e >2013-12-04 07:47:43,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [7c7015fa] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 419a03e >2013-12-04 07:47:44,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [7c7015fa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 419a03e >2013-12-04 07:47:44,241 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-78) [7c7015fa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to fetch gluster volume list from server host1. >2013-12-04 07:47:44,261 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:47:44,264 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, status=NonOperational, nonOperationalReason=GLUSTER_COMMAND_FAILED), log id: 2646c10a >2013-12-04 07:47:44,269 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, SetVdsStatusVDSCommand, log id: 2646c10a >2013-12-04 07:47:44,288 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-78) [1f2a7840] Correlation ID: 1f2a7840, Job ID: 8d0f387d-f6c2-42aa-a589-8976f89a3d19, Call Stack: null, Custom Event ID: -1, Message: Gluster command [gluster peer status] failed on server host1. >2013-12-04 07:47:44,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 72de5ea3 >2013-12-04 07:47:44,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab41dbb2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee7ff95c}, log id: 72de5ea3 >2013-12-04 07:47:49,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75a09d2e >2013-12-04 07:47:50,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 75a09d2e >2013-12-04 07:47:50,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4362c606 >2013-12-04 07:47:50,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c590ac43, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df22469e}, log id: 4362c606 >2013-12-04 07:47:55,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 706e6b45 >2013-12-04 07:47:55,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 706e6b45 >2013-12-04 07:47:55,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 694cc70b >2013-12-04 07:47:56,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@629ece87, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6796a64d}, log id: 694cc70b >2013-12-04 07:48:01,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f50ec61 >2013-12-04 07:48:01,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:DISCONNECTED], log id: 5f50ec61 >2013-12-04 07:48:01,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2a49bf9f >2013-12-04 07:48:02,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30352125, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9432fe7d}, log id: 2a49bf9f >2013-12-04 07:48:07,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34be9e6b >2013-12-04 07:48:07,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34be9e6b >2013-12-04 07:48:07,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ba9dfd1 >2013-12-04 07:48:07,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@927a2a55, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28aa494c}, log id: 2ba9dfd1 >2013-12-04 07:48:12,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1388f8de >2013-12-04 07:48:17,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1388f8de >2013-12-04 07:48:17,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ea6c645 >2013-12-04 07:48:17,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f9cf891, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@782da4ad}, log id: 3ea6c645 >2013-12-04 07:48:18,657 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-04 07:48:18,658 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:48:18,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a5fd7d3 >2013-12-04 07:48:18,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5a5fd7d3 >2013-12-04 07:48:22,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20747083 >2013-12-04 07:48:23,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20747083 >2013-12-04 07:48:23,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32a4e38e >2013-12-04 07:48:23,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbfab798, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c24d5a41}, log id: 32a4e38e >2013-12-04 07:48:28,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14dfca47 >2013-12-04 07:48:29,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 14dfca47 >2013-12-04 07:48:29,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 46159cf0 >2013-12-04 07:48:29,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c96cec21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68e8bb9}, log id: 46159cf0 >2013-12-04 07:48:34,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 74f07823 >2013-12-04 07:48:34,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 74f07823 >2013-12-04 07:48:34,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68f6cf82 >2013-12-04 07:48:35,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a03c2fbe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0cec254}, log id: 68f6cf82 >2013-12-04 07:48:40,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75cc8a09 >2013-12-04 07:48:40,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75cc8a09 >2013-12-04 07:48:40,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 265a65c6 >2013-12-04 07:48:40,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e4df45d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a7b598a}, log id: 265a65c6 >2013-12-04 07:48:46,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4f432a3b >2013-12-04 07:48:46,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f432a3b >2013-12-04 07:48:46,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b6bcf3b >2013-12-04 07:48:46,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@147e9e5c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2fe2308}, log id: 7b6bcf3b >2013-12-04 07:48:51,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e6ddeaa >2013-12-04 07:48:52,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e6ddeaa >2013-12-04 07:48:52,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7d5ff15c >2013-12-04 07:48:52,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@652213d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e8975c2}, log id: 7d5ff15c >2013-12-04 07:48:57,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 53cf803f >2013-12-04 07:48:58,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53cf803f >2013-12-04 07:48:58,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4c41beba >2013-12-04 07:48:58,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ebe5101, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35ecea76}, log id: 4c41beba >2013-12-04 07:49:03,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66d0b4b8 >2013-12-04 07:49:03,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66d0b4b8 >2013-12-04 07:49:03,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6974c513 >2013-12-04 07:49:04,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22c839fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fe1d1b7}, log id: 6974c513 >2013-12-04 07:49:09,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 645baa1 >2013-12-04 07:49:09,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 645baa1 >2013-12-04 07:49:09,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7d74347f >2013-12-04 07:49:10,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dc5687b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80f5886d}, log id: 7d74347f >2013-12-04 07:49:15,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 49b8e04a >2013-12-04 07:49:15,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49b8e04a >2013-12-04 07:49:15,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1792e576 >2013-12-04 07:49:15,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@259caf04, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bafd4ae5}, log id: 1792e576 >2013-12-04 07:49:18,961 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-04 07:49:18,961 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:49:18,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d16af83 >2013-12-04 07:49:19,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: d16af83 >2013-12-04 07:49:20,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1e057b75 >2013-12-04 07:49:20,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@143ad35e, log id: 1e057b75 >2013-12-04 07:49:20,778 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected change in status of brick 10.70.37.74:/rhs/brick5/b3 of volume dis_rep_vol from DOWN to UP. >2013-12-04 07:49:20,784 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected change in status of brick 10.70.37.74:/rhs/brick4/b1 of volume dis_rep_vol from DOWN to UP. >2013-12-04 07:49:20,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 78fda01d >2013-12-04 07:49:20,999 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-40) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 07:49:21,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@460d2733, log id: 78fda01d >2013-12-04 07:49:21,062 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-16) Error while refreshing brick statuses for volume dis_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:49:21,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 988a933 >2013-12-04 07:49:21,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 988a933 >2013-12-04 07:49:21,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ea4bde8 >2013-12-04 07:49:21,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@334fe05e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbdbe2ac}, log id: 1ea4bde8 >2013-12-04 07:49:26,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e4a24a4 >2013-12-04 07:49:27,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e4a24a4 >2013-12-04 07:49:27,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6d400d3b >2013-12-04 07:49:27,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@955adcf5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3b3d3ef}, log id: 6d400d3b >2013-12-04 07:49:32,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27e1eb0d >2013-12-04 07:49:33,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 27e1eb0d >2013-12-04 07:49:33,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 111cce13 >2013-12-04 07:49:33,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6cfcd9e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41ed95a6}, log id: 111cce13 >2013-12-04 07:49:38,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57c9c2ee >2013-12-04 07:49:39,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57c9c2ee >2013-12-04 07:49:39,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 511eae62 >2013-12-04 07:49:39,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21e156f3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e69b772}, log id: 511eae62 >2013-12-04 07:49:44,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15d79eb1 >2013-12-04 07:49:44,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15d79eb1 >2013-12-04 07:49:44,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ad5b6f1 >2013-12-04 07:49:45,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4602c484, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@754c2f3}, log id: ad5b6f1 >2013-12-04 07:49:50,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 28448121 >2013-12-04 07:49:50,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28448121 >2013-12-04 07:49:50,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 26419d24 >2013-12-04 07:49:50,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c44d51ca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0437a3e}, log id: 26419d24 >2013-12-04 07:49:55,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69a97ecf >2013-12-04 07:49:56,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69a97ecf >2013-12-04 07:49:56,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d3dbc8c >2013-12-04 07:49:56,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6922648, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3517a24}, log id: d3dbc8c >2013-12-04 07:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [44971035] Autorecovering 1 hosts >2013-12-04 07:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [44971035] Autorecovering hosts id: 4c17e50e-8225-48c6-bcb3-bfba4ec37037, name : host1 >2013-12-04 07:50:00,014 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-29) [63e90d26] Lock Acquired to object EngineLock [exclusiveLocks= key: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 value: VDS >, sharedLocks= ] >2013-12-04 07:50:00,015 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-29) [63e90d26] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:50:00,015 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-29) [63e90d26] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2013-12-04 07:50:00,015 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-29) [63e90d26] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2013-12-04 07:50:00,022 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-29) [63e90d26] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, status=Unassigned, nonOperationalReason=NONE), log id: 5c338179 >2013-12-04 07:50:00,028 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-29) [63e90d26] FINISH, SetVdsStatusVDSCommand, log id: 5c338179 >2013-12-04 07:50:00,031 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-29) [63e90d26] START, ActivateVdsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4036b62d >2013-12-04 07:50:00,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-29) [63e90d26] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, vds=Host[host1]), log id: 1e039225 >2013-12-04 07:50:00,128 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-29) [63e90d26] FINISH, GetHardwareInfoVDSCommand, log id: 1e039225 >2013-12-04 07:50:00,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [63e90d26] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41d5095 >2013-12-04 07:50:00,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [63e90d26] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 41d5095 >2013-12-04 07:50:00,663 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:50:00,664 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 4036b62d >2013-12-04 07:50:00,793 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2013-12-04 07:50:00,797 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] Lock freed to object EngineLock [exclusiveLocks= key: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 value: VDS >, sharedLocks= ] >2013-12-04 07:50:01,612 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, vds=Host[host1]), log id: 41efa147 >2013-12-04 07:50:01,638 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GetHardwareInfoVDSCommand, log id: 41efa147 >2013-12-04 07:50:01,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 35200067 >2013-12-04 07:50:01,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34c8ec2 >2013-12-04 07:50:02,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 35200067 >2013-12-04 07:50:02,138 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-85) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host host1. >2013-12-04 07:50:02,156 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-85) [2f533d48] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 5849b030-626e-47cb-ad90-3ce782d831b3 Type: StoragePool >2013-12-04 07:50:02,158 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-85) [2f533d48] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 07:50:02,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34c8ec2 >2013-12-04 07:50:02,279 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-85) [2f533d48] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 07:50:02,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 764feb75 >2013-12-04 07:50:02,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cf8c934, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bf8d837}, log id: 764feb75 >2013-12-04 07:50:02,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [2f533d48] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f4dc326 >2013-12-04 07:50:03,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [2f533d48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f4dc326 >2013-12-04 07:50:03,098 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-04 07:50:07,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 335a6dd4 >2013-12-04 07:50:08,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 335a6dd4 >2013-12-04 07:50:08,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 479bd5c7 >2013-12-04 07:50:08,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c65d9177, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3982e5b0}, log id: 479bd5c7 >2013-12-04 07:50:13,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e059f0c >2013-12-04 07:50:13,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e059f0c >2013-12-04 07:50:13,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 706386f7 >2013-12-04 07:50:14,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7682aa7f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@329d3f84}, log id: 706386f7 >2013-12-04 07:50:19,266 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) No up server in cluster >2013-12-04 07:50:19,266 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:50:19,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 382af965 >2013-12-04 07:50:19,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36d069c9 >2013-12-04 07:50:19,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, return: [], log id: 382af965 >2013-12-04 07:50:19,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36d069c9 >2013-12-04 07:50:19,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2bb6628a >2013-12-04 07:50:20,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc95f1c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@272fde69}, log id: 2bb6628a >2013-12-04 07:50:25,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a8f6f5e >2013-12-04 07:50:25,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a8f6f5e >2013-12-04 07:50:25,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d6382e7 >2013-12-04 07:50:25,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf41ceb6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ba4916e}, log id: 6d6382e7 >2013-12-04 07:50:30,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 578e6322 >2013-12-04 07:50:31,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 578e6322 >2013-12-04 07:50:31,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77e083a8 >2013-12-04 07:50:31,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@394d83ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edec67c}, log id: 77e083a8 >2013-12-04 07:50:36,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6120475e >2013-12-04 07:50:37,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6120475e >2013-12-04 07:50:37,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: e29fcaa >2013-12-04 07:50:37,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47e3a132, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99ca8a9f}, log id: e29fcaa >2013-12-04 07:50:42,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2979c7cc >2013-12-04 07:50:43,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2979c7cc >2013-12-04 07:50:43,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 44f7d073 >2013-12-04 07:50:43,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6aae987b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba98e8af}, log id: 44f7d073 >2013-12-04 07:50:48,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16cb8873 >2013-12-04 07:50:48,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 16cb8873 >2013-12-04 07:50:48,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 21d6ec02 >2013-12-04 07:50:49,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cf7526a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52899262}, log id: 21d6ec02 >2013-12-04 07:50:54,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 455f9958 >2013-12-04 07:50:54,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 455f9958 >2013-12-04 07:50:54,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5707c5eb >2013-12-04 07:50:54,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0d603bd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d20ddcc}, log id: 5707c5eb >2013-12-04 07:51:00,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7eaa39f7 >2013-12-04 07:51:00,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7eaa39f7 >2013-12-04 07:51:00,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 280e0bb7 >2013-12-04 07:51:00,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca80df0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e473c910}, log id: 280e0bb7 >2013-12-04 07:51:05,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a5cbdec >2013-12-04 07:51:06,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7a5cbdec >2013-12-04 07:51:06,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 302384ba >2013-12-04 07:51:06,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5aae43b1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79d2f2e}, log id: 302384ba >2013-12-04 07:51:11,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f15e730 >2013-12-04 07:51:12,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 5f15e730 >2013-12-04 07:51:12,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79a5b56b >2013-12-04 07:51:12,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@594ba9f7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d58805d}, log id: 79a5b56b >2013-12-04 07:51:17,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59c0eb76 >2013-12-04 07:51:18,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59c0eb76 >2013-12-04 07:51:18,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 36be9e58 >2013-12-04 07:51:18,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cefd47c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47ed57d}, log id: 36be9e58 >2013-12-04 07:51:19,571 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-04 07:51:19,571 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:51:19,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a997dbf >2013-12-04 07:51:19,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3a997dbf >2013-12-04 07:51:23,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 312bd2b0 >2013-12-04 07:51:23,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 312bd2b0 >2013-12-04 07:51:23,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ea56fe >2013-12-04 07:51:24,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea1fd131, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21a21a37}, log id: 7ea56fe >2013-12-04 07:51:29,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2743a2b >2013-12-04 07:51:29,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2743a2b >2013-12-04 07:51:29,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 68465f25 >2013-12-04 07:51:29,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fa3748c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b4a4009}, log id: 68465f25 >2013-12-04 07:51:35,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2060aa70 >2013-12-04 07:51:35,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2060aa70 >2013-12-04 07:51:35,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 29dd2ee4 >2013-12-04 07:51:35,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18073f06, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ac92fb2}, log id: 29dd2ee4 >2013-12-04 07:51:40,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c6e184c >2013-12-04 07:51:41,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 2c6e184c >2013-12-04 07:51:41,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5993b111 >2013-12-04 07:51:41,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc4aca1b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c042107a}, log id: 5993b111 >2013-12-04 07:51:46,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 448a40fa >2013-12-04 07:51:47,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 448a40fa >2013-12-04 07:51:47,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40e5f50f >2013-12-04 07:51:47,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88aac74e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c0bf42}, log id: 40e5f50f >2013-12-04 07:51:52,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7c0b2939 >2013-12-04 07:51:52,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c0b2939 >2013-12-04 07:51:52,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1262be8 >2013-12-04 07:51:53,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17cf989c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8bc7a26}, log id: 1262be8 >2013-12-04 07:51:58,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 211327b6 >2013-12-04 07:51:58,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 211327b6 >2013-12-04 07:51:58,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f75101e >2013-12-04 07:51:59,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f55e500, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba97186a}, log id: 7f75101e >2013-12-04 07:52:03,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-9) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12abf539 >2013-12-04 07:52:03,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-9) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@49392f9d, log id: 12abf539 >2013-12-04 07:52:04,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c9f5557 >2013-12-04 07:52:04,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: c9f5557 >2013-12-04 07:52:04,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1813a3ca >2013-12-04 07:52:04,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98bcb0c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79be4cd2}, log id: 1813a3ca >2013-12-04 07:52:09,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1131ccf1 >2013-12-04 07:52:10,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1131ccf1 >2013-12-04 07:52:10,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d0d56ad >2013-12-04 07:52:10,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1b22fae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61ac873}, log id: 6d0d56ad >2013-12-04 07:52:15,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 64d09584 >2013-12-04 07:52:16,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 64d09584 >2013-12-04 07:52:16,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17382c61 >2013-12-04 07:52:16,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55bb7b11, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96c39c00}, log id: 17382c61 >2013-12-04 07:52:19,875 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-04 07:52:19,875 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:52:19,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3cf29914 >2013-12-04 07:52:20,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3cf29914 >2013-12-04 07:52:21,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f9f3dcf >2013-12-04 07:52:22,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7f9f3dcf >2013-12-04 07:52:22,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38322944 >2013-12-04 07:52:22,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c4f6d8c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9e84022}, log id: 38322944 >2013-12-04 07:52:27,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2281a222 >2013-12-04 07:52:27,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2281a222 >2013-12-04 07:52:27,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 339960fc >2013-12-04 07:52:28,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e18888c4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ee38a44}, log id: 339960fc >2013-12-04 07:52:33,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 14232580 >2013-12-04 07:52:33,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 14232580 >2013-12-04 07:52:33,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 33f725ab >2013-12-04 07:52:33,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96e513e2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cfb58db}, log id: 33f725ab >2013-12-04 07:52:38,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d475c79 >2013-12-04 07:52:39,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d475c79 >2013-12-04 07:52:39,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 756002a2 >2013-12-04 07:52:39,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad23f85e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b217bf7}, log id: 756002a2 >2013-12-04 07:52:44,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4446cc7e >2013-12-04 07:52:45,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4446cc7e >2013-12-04 07:52:45,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3be74fe4 >2013-12-04 07:52:45,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a873f741, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@532ae9d6}, log id: 3be74fe4 >2013-12-04 07:52:50,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 23f48271 >2013-12-04 07:52:51,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23f48271 >2013-12-04 07:52:51,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 365c0ae7 >2013-12-04 07:52:51,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e69f1c52, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a04b8e89}, log id: 365c0ae7 >2013-12-04 07:52:56,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4484e46b >2013-12-04 07:52:56,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4484e46b >2013-12-04 07:52:56,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 383b9c6e >2013-12-04 07:52:57,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31bf89a2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51c5a5c7}, log id: 383b9c6e >2013-12-04 07:53:02,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 613c5b94 >2013-12-04 07:53:02,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 613c5b94 >2013-12-04 07:53:02,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 384b5165 >2013-12-04 07:53:02,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9fd5c93, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd02263}, log id: 384b5165 >2013-12-04 07:53:08,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 250c46d3 >2013-12-04 07:53:08,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 250c46d3 >2013-12-04 07:53:08,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 65257b0e >2013-12-04 07:53:08,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3cdf37e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68f643e}, log id: 65257b0e >2013-12-04 07:53:13,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 701bc665 >2013-12-04 07:53:14,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 701bc665 >2013-12-04 07:53:14,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b9c262 >2013-12-04 07:53:14,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66644a55, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1ee6864}, log id: 5b9c262 >2013-12-04 07:53:19,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75dca55 >2013-12-04 07:53:20,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75dca55 >2013-12-04 07:53:20,187 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) No up server in cluster >2013-12-04 07:53:20,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d1cadce >2013-12-04 07:53:20,187 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:53:20,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3abd6b7f >2013-12-04 07:53:20,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dad35e12, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32a5e3c1}, log id: d1cadce >2013-12-04 07:53:20,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3abd6b7f >2013-12-04 07:53:25,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 313ac901 >2013-12-04 07:53:25,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 313ac901 >2013-12-04 07:53:25,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11f90255 >2013-12-04 07:53:26,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d3c4ab4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ad1dc8}, log id: 11f90255 >2013-12-04 07:53:31,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1355e75 >2013-12-04 07:53:31,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 1355e75 >2013-12-04 07:53:31,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 66522c58 >2013-12-04 07:53:32,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de3c0cfe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79802b08}, log id: 66522c58 >2013-12-04 07:53:37,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59df9e0c >2013-12-04 07:53:37,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 59df9e0c >2013-12-04 07:53:37,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 301da325 >2013-12-04 07:53:37,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f3e859e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@398369ba}, log id: 301da325 >2013-12-04 07:53:42,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7235bfb0 >2013-12-04 07:53:43,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7235bfb0 >2013-12-04 07:53:43,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 71f1e57f >2013-12-04 07:53:43,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cca2730, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3ae23ce}, log id: 71f1e57f >2013-12-04 07:53:48,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61bf6c93 >2013-12-04 07:53:49,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61bf6c93 >2013-12-04 07:53:49,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 291a5131 >2013-12-04 07:53:49,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccef8358, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc804206}, log id: 291a5131 >2013-12-04 07:53:54,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 42e80dfa >2013-12-04 07:53:55,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42e80dfa >2013-12-04 07:53:55,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 64995bde >2013-12-04 07:53:55,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52ef603c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7d9ffc0}, log id: 64995bde >2013-12-04 07:54:00,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 785ab67c >2013-12-04 07:54:00,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 785ab67c >2013-12-04 07:54:00,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4aaa5e75 >2013-12-04 07:54:01,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13107b7d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc8e4871}, log id: 4aaa5e75 >2013-12-04 07:54:06,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2a43e81b >2013-12-04 07:54:06,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a43e81b >2013-12-04 07:54:06,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 405c11fd >2013-12-04 07:54:07,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97947dfd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54d95ad}, log id: 405c11fd >2013-12-04 07:54:12,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 531b852 >2013-12-04 07:54:12,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 531b852 >2013-12-04 07:54:12,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6fd593c9 >2013-12-04 07:54:12,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ada7376, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc209005}, log id: 6fd593c9 >2013-12-04 07:54:17,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 65c9bb43 >2013-12-04 07:54:18,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 65c9bb43 >2013-12-04 07:54:18,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 454b5e2d >2013-12-04 07:54:18,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9977ba3e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c25948ac}, log id: 454b5e2d >2013-12-04 07:54:20,486 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) No up server in cluster >2013-12-04 07:54:20,486 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:54:20,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1aef829c >2013-12-04 07:54:20,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1aef829c >2013-12-04 07:54:21,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 784281cb >2013-12-04 07:54:21,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1ab6aa6f, log id: 784281cb >2013-12-04 07:54:21,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4e6f6b1c >2013-12-04 07:54:21,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@144b1039, log id: 4e6f6b1c >2013-12-04 07:54:21,643 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-43) Error while refreshing brick statuses for volume dis_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:54:23,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2658a952 >2013-12-04 07:54:24,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 2658a952 >2013-12-04 07:54:24,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6b0a025c >2013-12-04 07:54:24,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@456aba49, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22202c1e}, log id: 6b0a025c >2013-12-04 07:54:29,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 49a270ff >2013-12-04 07:54:30,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 49a270ff >2013-12-04 07:54:30,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22319933 >2013-12-04 07:54:30,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34cf7ca0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41b85700}, log id: 22319933 >2013-12-04 07:54:35,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3164a934 >2013-12-04 07:54:35,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3164a934 >2013-12-04 07:54:35,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b4202f9 >2013-12-04 07:54:36,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23fed2a1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1609673}, log id: 6b4202f9 >2013-12-04 07:54:41,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b14156d >2013-12-04 07:54:41,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: b14156d >2013-12-04 07:54:41,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 346d35df >2013-12-04 07:54:41,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3de58b4a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7c933f9}, log id: 346d35df >2013-12-04 07:54:46,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ac1b955 >2013-12-04 07:54:47,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 4ac1b955 >2013-12-04 07:54:47,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1b20637c >2013-12-04 07:54:47,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7ef1e77, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5ba2729}, log id: 1b20637c >2013-12-04 07:54:52,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4a4bdbc >2013-12-04 07:54:53,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a4bdbc >2013-12-04 07:54:53,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7c8d410 >2013-12-04 07:54:53,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db8f062d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fce95da0}, log id: 7c8d410 >2013-12-04 07:54:58,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 118313fc >2013-12-04 07:54:59,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 118313fc >2013-12-04 07:54:59,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5511876f >2013-12-04 07:54:59,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24f4a14f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@becc0041}, log id: 5511876f >2013-12-04 07:55:04,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74bafcff >2013-12-04 07:55:04,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 74bafcff >2013-12-04 07:55:04,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 30b80a0b >2013-12-04 07:55:05,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dcd6cbd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64050878}, log id: 30b80a0b >2013-12-04 07:55:10,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3dc49e8f >2013-12-04 07:55:10,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 3dc49e8f >2013-12-04 07:55:10,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2a04b710 >2013-12-04 07:55:11,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e4afcb3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5011769}, log id: 2a04b710 >2013-12-04 07:55:16,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f249592 >2013-12-04 07:55:16,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 6f249592 >2013-12-04 07:55:16,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4faf9b5b >2013-12-04 07:55:16,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23f95862, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@354e9d41}, log id: 4faf9b5b >2013-12-04 07:55:20,796 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) No up server in cluster >2013-12-04 07:55:20,796 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:55:20,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2f9e3d9d >2013-12-04 07:55:21,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2f9e3d9d >2013-12-04 07:55:21,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5ad96f5 >2013-12-04 07:55:22,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ad96f5 >2013-12-04 07:55:22,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 779c85cf >2013-12-04 07:55:22,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7747f459, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65dc2fb4}, log id: 779c85cf >2013-12-04 07:55:27,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 752d3abc >2013-12-04 07:55:28,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 752d3abc >2013-12-04 07:55:28,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 648faec3 >2013-12-04 07:55:28,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7005db8e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ccc7bfe}, log id: 648faec3 >2013-12-04 07:55:33,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d228124 >2013-12-04 07:55:34,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d228124 >2013-12-04 07:55:34,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 18b0f3b1 >2013-12-04 07:55:34,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13072890, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8460a95e}, log id: 18b0f3b1 >2013-12-04 07:55:39,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7b3e41d8 >2013-12-04 07:55:39,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7b3e41d8 >2013-12-04 07:55:39,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 76b49f8e >2013-12-04 07:55:40,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bb010e3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37d98a01}, log id: 76b49f8e >2013-12-04 07:55:45,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61cd27a9 >2013-12-04 07:55:45,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61cd27a9 >2013-12-04 07:55:45,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 470edcfc >2013-12-04 07:55:45,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df26859e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8dd52c5}, log id: 470edcfc >2013-12-04 07:55:50,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 67aba65f >2013-12-04 07:55:51,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 67aba65f >2013-12-04 07:55:51,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c85acfc >2013-12-04 07:55:51,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba3b50ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98231095}, log id: c85acfc >2013-12-04 07:55:56,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d9bd233 >2013-12-04 07:55:57,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 4d9bd233 >2013-12-04 07:55:57,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5be34bce >2013-12-04 07:55:57,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e91f724, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5167c33d}, log id: 5be34bce >2013-12-04 07:56:02,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b95c3be >2013-12-04 07:56:03,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b95c3be >2013-12-04 07:56:03,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6e60c844 >2013-12-04 07:56:03,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45072843, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60e50387}, log id: 6e60c844 >2013-12-04 07:56:08,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7841bea9 >2013-12-04 07:56:08,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7841bea9 >2013-12-04 07:56:08,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4190d9a6 >2013-12-04 07:56:09,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29099f91, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fea4b67d}, log id: 4190d9a6 >2013-12-04 07:56:14,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 49a1af37 >2013-12-04 07:56:14,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 49a1af37 >2013-12-04 07:56:14,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 69d8e10a >2013-12-04 07:56:15,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e567a2d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa103d59}, log id: 69d8e10a >2013-12-04 07:56:20,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2391ce70 >2013-12-04 07:56:20,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2391ce70 >2013-12-04 07:56:20,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 66fd74a >2013-12-04 07:56:20,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af8edf7d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7218e9a4}, log id: 66fd74a >2013-12-04 07:56:21,105 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) No up server in cluster >2013-12-04 07:56:21,105 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:56:21,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 49f63df >2013-12-04 07:56:21,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, return: [], log id: 49f63df >2013-12-04 07:56:25,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 339f6d82 >2013-12-04 07:56:26,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 339f6d82 >2013-12-04 07:56:26,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 320dc562 >2013-12-04 07:56:26,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb25f8a4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4bfd3aa}, log id: 320dc562 >2013-12-04 07:56:31,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9ba0718 >2013-12-04 07:56:32,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 9ba0718 >2013-12-04 07:56:32,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18c1e114 >2013-12-04 07:56:32,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1fecd5d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f08a9db0}, log id: 18c1e114 >2013-12-04 07:56:37,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 503e262 >2013-12-04 07:56:37,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 503e262 >2013-12-04 07:56:37,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ab2d0c6 >2013-12-04 07:56:38,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62d52e05, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d6c21e3}, log id: 2ab2d0c6 >2013-12-04 07:56:43,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2307dea9 >2013-12-04 07:56:43,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2307dea9 >2013-12-04 07:56:43,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b94c254 >2013-12-04 07:56:44,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8458bad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4fd82be}, log id: b94c254 >2013-12-04 07:56:49,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71e6ab03 >2013-12-04 07:56:49,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71e6ab03 >2013-12-04 07:56:49,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 78f6584b >2013-12-04 07:56:49,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@956b98c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48482235}, log id: 78f6584b >2013-12-04 07:56:54,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5e5a310e >2013-12-04 07:56:55,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 5e5a310e >2013-12-04 07:56:55,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69099863 >2013-12-04 07:56:55,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9543ba94, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ebaa336}, log id: 69099863 >2013-12-04 07:57:00,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b61fd90 >2013-12-04 07:57:01,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b61fd90 >2013-12-04 07:57:01,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5ce26c31 >2013-12-04 07:57:01,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e66956a4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dad997c6}, log id: 5ce26c31 >2013-12-04 07:57:06,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 18393a6f >2013-12-04 07:57:07,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18393a6f >2013-12-04 07:57:07,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 31c87822 >2013-12-04 07:57:07,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@921f9ad3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a76d175b}, log id: 31c87822 >2013-12-04 07:57:12,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15a4f4c3 >2013-12-04 07:57:12,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15a4f4c3 >2013-12-04 07:57:12,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 17be1053 >2013-12-04 07:57:13,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1f517ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af0a43a6}, log id: 17be1053 >2013-12-04 07:57:18,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b13b284 >2013-12-04 07:57:18,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b13b284 >2013-12-04 07:57:18,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79e108a2 >2013-12-04 07:57:18,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fffa0921, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b76b269}, log id: 79e108a2 >2013-12-04 07:57:21,406 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) No up server in cluster >2013-12-04 07:57:21,406 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:57:21,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2740c584 >2013-12-04 07:57:21,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2740c584 >2013-12-04 07:57:24,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 88d01df >2013-12-04 07:57:24,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 88d01df >2013-12-04 07:57:24,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 73751996 >2013-12-04 07:57:24,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc955a43, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37fa5f8d}, log id: 73751996 >2013-12-04 07:57:29,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70de01b8 >2013-12-04 07:57:30,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70de01b8 >2013-12-04 07:57:30,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2cfcd9b2 >2013-12-04 07:57:30,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f65e7b58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9496a722}, log id: 2cfcd9b2 >2013-12-04 07:57:35,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d5a8b8a >2013-12-04 07:57:36,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 2d5a8b8a >2013-12-04 07:57:36,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 717a47f >2013-12-04 07:57:36,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@141a90e5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b4c6c47}, log id: 717a47f >2013-12-04 07:57:41,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 777c6ad2 >2013-12-04 07:57:41,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 777c6ad2 >2013-12-04 07:57:41,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47f174f6 >2013-12-04 07:57:42,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9b3a32e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10b146bf}, log id: 47f174f6 >2013-12-04 07:57:47,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b44b5 >2013-12-04 07:57:47,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b44b5 >2013-12-04 07:57:47,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3736ca7 >2013-12-04 07:57:48,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@975d5f00, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2d7e5db}, log id: 3736ca7 >2013-12-04 07:57:53,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: a29621f >2013-12-04 07:57:53,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: a29621f >2013-12-04 07:57:53,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6e88249f >2013-12-04 07:57:53,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10446aa6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@457063cf}, log id: 6e88249f >2013-12-04 07:57:58,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a460fa3 >2013-12-04 07:57:59,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a460fa3 >2013-12-04 07:57:59,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 69aad10f >2013-12-04 07:57:59,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98c6e403, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb468201}, log id: 69aad10f >2013-12-04 07:58:04,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30d00b4c >2013-12-04 07:58:05,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30d00b4c >2013-12-04 07:58:05,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71400d6 >2013-12-04 07:58:05,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@777701cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@919928ff}, log id: 71400d6 >2013-12-04 07:58:10,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57942673 >2013-12-04 07:58:11,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 57942673 >2013-12-04 07:58:11,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 15396f2c >2013-12-04 07:58:11,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50347794, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb2bc4e1}, log id: 15396f2c >2013-12-04 07:58:16,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 31bb269d >2013-12-04 07:58:16,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 31bb269d >2013-12-04 07:58:16,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41348a25 >2013-12-04 07:58:17,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@355c6932, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6f82fbb}, log id: 41348a25 >2013-12-04 07:58:21,694 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) No up server in cluster >2013-12-04 07:58:21,694 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:58:21,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4fa51e0f >2013-12-04 07:58:21,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4fa51e0f >2013-12-04 07:58:22,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7358c966 >2013-12-04 07:58:22,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7358c966 >2013-12-04 07:58:22,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24221a7b >2013-12-04 07:58:22,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0a14bd2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81f10224}, log id: 24221a7b >2013-12-04 07:58:27,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1cd8e08b >2013-12-04 07:58:28,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cd8e08b >2013-12-04 07:58:28,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 382a6393 >2013-12-04 07:58:28,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78d52eb5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83c444c0}, log id: 382a6393 >2013-12-04 07:58:33,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18b0c6e9 >2013-12-04 07:58:34,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 18b0c6e9 >2013-12-04 07:58:34,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 155f727b >2013-12-04 07:58:34,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3edd6114, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c453cb07}, log id: 155f727b >2013-12-04 07:58:39,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a4e1064 >2013-12-04 07:58:40,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 6a4e1064 >2013-12-04 07:58:40,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1eccdd46 >2013-12-04 07:58:40,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@296e7273, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dabeb9e}, log id: 1eccdd46 >2013-12-04 07:58:45,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 791ec983 >2013-12-04 07:58:45,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 791ec983 >2013-12-04 07:58:45,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2ba47569 >2013-12-04 07:58:46,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9dc651a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@531feaf3}, log id: 2ba47569 >2013-12-04 07:58:51,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f1d7c4 >2013-12-04 07:58:51,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f1d7c4 >2013-12-04 07:58:51,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e0b7779 >2013-12-04 07:58:51,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd971708, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@175510a3}, log id: 7e0b7779 >2013-12-04 07:58:57,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 386f9cf0 >2013-12-04 07:58:57,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 386f9cf0 >2013-12-04 07:58:57,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: b84dc5a >2013-12-04 07:58:57,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@235123b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bae1207e}, log id: b84dc5a >2013-12-04 07:59:02,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2078d64f >2013-12-04 07:59:03,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2078d64f >2013-12-04 07:59:03,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6a5f6a05 >2013-12-04 07:59:03,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26dbc980, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a448053c}, log id: 6a5f6a05 >2013-12-04 07:59:08,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4851f39f >2013-12-04 07:59:09,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4851f39f >2013-12-04 07:59:09,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3956285c >2013-12-04 07:59:09,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18413233, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e93c8e63}, log id: 3956285c >2013-12-04 07:59:14,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ae60f4 >2013-12-04 07:59:14,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7ae60f4 >2013-12-04 07:59:15,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7316fd9d >2013-12-04 07:59:15,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5760fcd4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c87e5a96}, log id: 7316fd9d >2013-12-04 07:59:20,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4da14836 >2013-12-04 07:59:20,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 4da14836 >2013-12-04 07:59:20,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 759b73c0 >2013-12-04 07:59:21,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a84ea083, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9babb16c}, log id: 759b73c0 >2013-12-04 07:59:21,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: e54cf5e >2013-12-04 07:59:21,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7a345f6f, log id: e54cf5e >2013-12-04 07:59:21,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 465af17 >2013-12-04 07:59:21,994 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-04 07:59:21,994 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:59:22,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18682a20 >2013-12-04 07:59:22,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7823157e, log id: 465af17 >2013-12-04 07:59:22,238 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-48) [1f01d1f] Error while refreshing brick statuses for volume dis_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 07:59:22,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 18682a20 >2013-12-04 07:59:26,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b6bc73 >2013-12-04 07:59:26,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b6bc73 >2013-12-04 07:59:26,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41fe103c >2013-12-04 07:59:26,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6b8575c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@311fb2cc}, log id: 41fe103c >2013-12-04 07:59:31,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18c8d2ef >2013-12-04 07:59:32,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 18c8d2ef >2013-12-04 07:59:32,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 754867bf >2013-12-04 07:59:32,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2af503d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@118861a6}, log id: 754867bf >2013-12-04 07:59:37,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d5ae9b7 >2013-12-04 07:59:38,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d5ae9b7 >2013-12-04 07:59:38,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 44556476 >2013-12-04 07:59:38,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@658a8329, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bfdb598}, log id: 44556476 >2013-12-04 07:59:43,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7fcc1bd2 >2013-12-04 07:59:44,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fcc1bd2 >2013-12-04 07:59:44,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 77004602 >2013-12-04 07:59:44,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6fddfa6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e89dc53e}, log id: 77004602 >2013-12-04 07:59:49,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2837cd45 >2013-12-04 07:59:49,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2837cd45 >2013-12-04 07:59:49,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 13e983fa >2013-12-04 07:59:50,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f9d4201, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@873b14d8}, log id: 13e983fa >2013-12-04 07:59:55,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4836760a >2013-12-04 07:59:55,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 4836760a >2013-12-04 07:59:55,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18b40234 >2013-12-04 07:59:55,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e134cd3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d03041d}, log id: 18b40234 >2013-12-04 08:00:01,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4034154a >2013-12-04 08:00:01,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4034154a >2013-12-04 08:00:01,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61a1543a >2013-12-04 08:00:01,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7565b80d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73d304f8}, log id: 61a1543a >2013-12-04 08:00:06,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 722cc5c0 >2013-12-04 08:00:07,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 722cc5c0 >2013-12-04 08:00:07,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53650ee6 >2013-12-04 08:00:07,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61b9812, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a2fc5d7}, log id: 53650ee6 >2013-12-04 08:00:12,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2c65e559 >2013-12-04 08:00:13,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c65e559 >2013-12-04 08:00:13,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4f07c4f7 >2013-12-04 08:00:13,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@295e91bd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76896016}, log id: 4f07c4f7 >2013-12-04 08:00:18,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d1355a1 >2013-12-04 08:00:18,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d1355a1 >2013-12-04 08:00:18,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 73e10cb2 >2013-12-04 08:00:19,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8828857, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5d591a4}, log id: 73e10cb2 >2013-12-04 08:00:22,291 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-04 08:00:22,292 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:00:22,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4534764b >2013-12-04 08:00:22,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4534764b >2013-12-04 08:00:24,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7d67ccf2 >2013-12-04 08:00:24,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d67ccf2 >2013-12-04 08:00:24,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 509f231f >2013-12-04 08:00:25,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@687d51a6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5456062f}, log id: 509f231f >2013-12-04 08:00:30,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 229f404 >2013-12-04 08:00:30,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 229f404 >2013-12-04 08:00:30,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ee85352 >2013-12-04 08:00:31,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fafd8fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@255387c8}, log id: 1ee85352 >2013-12-04 08:00:36,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e943cf0 >2013-12-04 08:00:36,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e943cf0 >2013-12-04 08:00:36,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 24c023e6 >2013-12-04 08:00:36,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc010447, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@379cb708}, log id: 24c023e6 >2013-12-04 08:00:41,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71a9af3e >2013-12-04 08:00:42,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71a9af3e >2013-12-04 08:00:42,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6accb6a2 >2013-12-04 08:00:42,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82db7475, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc666ac4}, log id: 6accb6a2 >2013-12-04 08:00:47,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3282df88 >2013-12-04 08:00:48,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3282df88 >2013-12-04 08:00:48,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a7a157b >2013-12-04 08:00:48,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d00d6b0b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68048dd7}, log id: 4a7a157b >2013-12-04 08:00:53,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18339b21 >2013-12-04 08:00:54,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 18339b21 >2013-12-04 08:00:54,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 668084bd >2013-12-04 08:00:54,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@376598fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e15f67fe}, log id: 668084bd >2013-12-04 08:00:59,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45274a93 >2013-12-04 08:00:59,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 45274a93 >2013-12-04 08:00:59,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14396b17 >2013-12-04 08:01:00,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6b19f15, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc02409d}, log id: 14396b17 >2013-12-04 08:01:05,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1d65af60 >2013-12-04 08:01:05,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d65af60 >2013-12-04 08:01:05,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ae9fd80 >2013-12-04 08:01:06,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5668c209, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7346668}, log id: 2ae9fd80 >2013-12-04 08:01:11,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f41f4d0 >2013-12-04 08:01:11,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f41f4d0 >2013-12-04 08:01:11,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f258713 >2013-12-04 08:01:11,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce6babd7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a67fce6e}, log id: 6f258713 >2013-12-04 08:01:16,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b42ea05 >2013-12-04 08:01:17,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 4b42ea05 >2013-12-04 08:01:17,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 19291db4 >2013-12-04 08:01:17,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90108b5d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@603e60f0}, log id: 19291db4 >2013-12-04 08:01:22,598 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-04 08:01:22,598 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:01:22,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 602feee8 >2013-12-04 08:01:22,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f87756 >2013-12-04 08:01:22,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 602feee8 >2013-12-04 08:01:23,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f87756 >2013-12-04 08:01:23,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 55f999d9 >2013-12-04 08:01:23,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fefb133, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6880e37}, log id: 55f999d9 >2013-12-04 08:01:28,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21c8435f >2013-12-04 08:01:29,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 21c8435f >2013-12-04 08:01:29,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 61c69ec1 >2013-12-04 08:01:29,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f55339b6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55eb5348}, log id: 61c69ec1 >2013-12-04 08:01:34,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4b9f25dc >2013-12-04 08:01:34,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b9f25dc >2013-12-04 08:01:34,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5c41a3ff >2013-12-04 08:01:35,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e4542e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6330fdb}, log id: 5c41a3ff >2013-12-04 08:01:40,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 107c0f2c >2013-12-04 08:01:40,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 107c0f2c >2013-12-04 08:01:40,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 176733d >2013-12-04 08:01:40,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1144faef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8578c0a7}, log id: 176733d >2013-12-04 08:01:45,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36e6192b >2013-12-04 08:01:46,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36e6192b >2013-12-04 08:01:46,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ab3e233 >2013-12-04 08:01:46,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85e2f688, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cec81170}, log id: 1ab3e233 >2013-12-04 08:01:51,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b9c5048 >2013-12-04 08:01:52,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: b9c5048 >2013-12-04 08:01:52,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 777339e7 >2013-12-04 08:01:52,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4346745e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dd58fd3}, log id: 777339e7 >2013-12-04 08:01:57,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5fb53132 >2013-12-04 08:01:58,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5fb53132 >2013-12-04 08:01:58,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3669079e >2013-12-04 08:01:58,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b875489, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb19c282}, log id: 3669079e >2013-12-04 08:02:03,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 171a5b96 >2013-12-04 08:02:03,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 171a5b96 >2013-12-04 08:02:03,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e52d9fa >2013-12-04 08:02:04,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0d771fe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6408e2b}, log id: 5e52d9fa >2013-12-04 08:02:09,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6194ac13 >2013-12-04 08:02:09,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6194ac13 >2013-12-04 08:02:09,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d2b9f55 >2013-12-04 08:02:10,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1f967d0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7c26f8}, log id: 3d2b9f55 >2013-12-04 08:02:15,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 51f81fde >2013-12-04 08:02:15,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 51f81fde >2013-12-04 08:02:15,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a96c664 >2013-12-04 08:02:15,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c54c0cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14d3a1c6}, log id: 6a96c664 >2013-12-04 08:02:20,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 10a60295 >2013-12-04 08:02:21,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 10a60295 >2013-12-04 08:02:21,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2233174a >2013-12-04 08:02:21,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51a2f8ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7e16c7c}, log id: 2233174a >2013-12-04 08:02:22,893 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-04 08:02:22,894 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:02:22,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43d91b2e >2013-12-04 08:02:23,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: 43d91b2e >2013-12-04 08:02:26,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: a59e155 >2013-12-04 08:02:27,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: a59e155 >2013-12-04 08:02:27,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6639a2cb >2013-12-04 08:02:27,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43aa89ce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df225de2}, log id: 6639a2cb >2013-12-04 08:02:32,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b108337 >2013-12-04 08:02:33,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b108337 >2013-12-04 08:02:33,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e12a30c >2013-12-04 08:02:33,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7f6dddf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5a8d57e}, log id: 7e12a30c >2013-12-04 08:02:38,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58d9ac17 >2013-12-04 08:02:38,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58d9ac17 >2013-12-04 08:02:38,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45204c07 >2013-12-04 08:02:39,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bb111c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa1e63e5}, log id: 45204c07 >2013-12-04 08:02:44,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 512912bc >2013-12-04 08:02:44,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 512912bc >2013-12-04 08:02:44,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b459487 >2013-12-04 08:02:44,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4587207b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e07879e2}, log id: b459487 >2013-12-04 08:02:49,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 23088de1 >2013-12-04 08:02:50,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 23088de1 >2013-12-04 08:02:50,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f0ecb77 >2013-12-04 08:02:50,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54f45bca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3046883}, log id: 1f0ecb77 >2013-12-04 08:02:55,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 10d80c53 >2013-12-04 08:02:56,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 10d80c53 >2013-12-04 08:02:56,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30def5e2 >2013-12-04 08:02:56,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@600c1492, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88ae3cd4}, log id: 30def5e2 >2013-12-04 08:03:01,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 682f9797 >2013-12-04 08:03:02,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 682f9797 >2013-12-04 08:03:02,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 400182c >2013-12-04 08:03:02,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34296835, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f88639b9}, log id: 400182c >2013-12-04 08:03:07,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4dfaf008 >2013-12-04 08:03:07,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4dfaf008 >2013-12-04 08:03:07,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 68f0e83f >2013-12-04 08:03:08,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf5430b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@951a6452}, log id: 68f0e83f >2013-12-04 08:03:13,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1116dcb4 >2013-12-04 08:03:13,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 1116dcb4 >2013-12-04 08:03:13,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7619d275 >2013-12-04 08:03:14,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1726cefc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ba02b7a}, log id: 7619d275 >2013-12-04 08:03:19,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5343f73c >2013-12-04 08:03:19,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5343f73c >2013-12-04 08:03:19,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39681463 >2013-12-04 08:03:19,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3b4e894, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d41afd1c}, log id: 39681463 >2013-12-04 08:03:23,193 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) No up server in cluster >2013-12-04 08:03:23,193 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:03:23,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c43709b >2013-12-04 08:03:23,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3c43709b >2013-12-04 08:03:24,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a12e243 >2013-12-04 08:03:25,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a12e243 >2013-12-04 08:03:25,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: cd83875 >2013-12-04 08:03:25,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d28939fe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d4b4d2a}, log id: cd83875 >2013-12-04 08:03:30,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c174c14 >2013-12-04 08:03:31,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 3c174c14 >2013-12-04 08:03:31,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 652a1aea >2013-12-04 08:03:31,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b3119bd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b279ec62}, log id: 652a1aea >2013-12-04 08:03:36,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ea43fa >2013-12-04 08:03:37,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ea43fa >2013-12-04 08:03:37,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 225f70f4 >2013-12-04 08:03:37,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f51e7a41, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47476e94}, log id: 225f70f4 >2013-12-04 08:03:42,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2f246aeb >2013-12-04 08:03:42,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f246aeb >2013-12-04 08:03:42,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: e62a783 >2013-12-04 08:03:43,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@277e8783, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3b3455f}, log id: e62a783 >2013-12-04 08:03:48,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 51e5815e >2013-12-04 08:03:48,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 51e5815e >2013-12-04 08:03:48,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3acb2122 >2013-12-04 08:03:49,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcf7f69, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8daa556}, log id: 3acb2122 >2013-12-04 08:03:54,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2c6eec09 >2013-12-04 08:03:54,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c6eec09 >2013-12-04 08:03:54,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 584c5256 >2013-12-04 08:03:54,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68cc94f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5a77f13}, log id: 584c5256 >2013-12-04 08:03:59,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26e23b86 >2013-12-04 08:04:00,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 26e23b86 >2013-12-04 08:04:00,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 128451d6 >2013-12-04 08:04:00,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9860eaff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe1f05ef}, log id: 128451d6 >2013-12-04 08:04:05,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 49c632ac >2013-12-04 08:04:06,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 49c632ac >2013-12-04 08:04:06,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 416ecf63 >2013-12-04 08:04:06,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea854bba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec5d3154}, log id: 416ecf63 >2013-12-04 08:04:11,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 445f95 >2013-12-04 08:04:12,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 445f95 >2013-12-04 08:04:12,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 60ff35ac >2013-12-04 08:04:12,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7aa07c63, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@119d9334}, log id: 60ff35ac >2013-12-04 08:04:17,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 37eb5cba >2013-12-04 08:04:17,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37eb5cba >2013-12-04 08:04:17,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e81e3bf >2013-12-04 08:04:18,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad1a51d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cae931f0}, log id: 3e81e3bf >2013-12-04 08:04:22,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30204ab0 >2013-12-04 08:04:22,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6fd89e23, log id: 30204ab0 >2013-12-04 08:04:22,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 76764532 >2013-12-04 08:04:22,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7934b942, log id: 76764532 >2013-12-04 08:04:22,810 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-12) Error while refreshing brick statuses for volume dis_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:04:23,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 517a7b0f >2013-12-04 08:04:23,486 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-04 08:04:23,486 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:04:23,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37bd8ad2 >2013-12-04 08:04:23,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 517a7b0f >2013-12-04 08:04:23,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 55c26e96 >2013-12-04 08:04:23,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 37bd8ad2 >2013-12-04 08:04:23,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f0e4db9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c08294a7}, log id: 55c26e96 >2013-12-04 08:04:28,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6567999d >2013-12-04 08:04:29,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 6567999d >2013-12-04 08:04:29,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: bb53a32 >2013-12-04 08:04:29,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c110508c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fbf0f6e}, log id: bb53a32 >2013-12-04 08:04:31,839 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-6) [1db1d9c1] Lock Acquired to object EngineLock [exclusiveLocks= key: dbfbcab7-6ec2-4bed-89de-aef7e409e97c value: GLUSTER >, sharedLocks= ] >2013-12-04 08:04:31,849 INFO [org.ovirt.engine.core.bll.gluster.StartRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-6) [1db1d9c1] Running command: StartRemoveGlusterVolumeBricksCommand internal: false. Entities affected : ID: dbfbcab7-6ec2-4bed-89de-aef7e409e97c Type: GlusterVolume >2013-12-04 08:04:31,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-6) [1db1d9c1] START, StartRemoveGlusterVolumeBricksVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 62401397 >2013-12-04 08:04:34,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 649574d2 >2013-12-04 08:04:35,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 649574d2 >2013-12-04 08:04:35,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 95efa3 >2013-12-04 08:04:35,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbaff497, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd70e4a}, log id: 95efa3 >2013-12-04 08:04:40,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 439f4ccb >2013-12-04 08:04:41,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 439f4ccb >2013-12-04 08:04:41,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37c39120 >2013-12-04 08:04:41,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86a7d227, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fac9e36}, log id: 37c39120 >2013-12-04 08:04:43,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.StartRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-6) [1db1d9c1] FINISH, StartRemoveGlusterVolumeBricksVDSCommand, return: org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@8383d282, log id: 62401397 >2013-12-04 08:04:43,379 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [1db1d9c1] Correlation ID: 1db1d9c1, Job ID: e7dde297-b138-4255-b199-b3937b4ea221, Call Stack: null, Custom Event ID: -1, Message: Started removing bricks from Volume dis_rep_vol >2013-12-04 08:04:46,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 430296c8 >2013-12-04 08:04:47,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 430296c8 >2013-12-04 08:04:47,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53075ead >2013-12-04 08:04:47,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c497f31a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9013e2fe}, log id: 53075ead >2013-12-04 08:04:47,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-11) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 680a19bf >2013-12-04 08:04:48,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-11) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@6e8562b1, log id: 680a19bf >2013-12-04 08:04:50,737 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-5) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:04:51,251 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-4) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:04:52,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-3) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 794b0d05 >2013-12-04 08:04:52,354 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-6) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:04:52,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 33cacff6 >2013-12-04 08:04:52,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 794b0d05 >2013-12-04 08:04:53,197 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-8) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:04:53,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 33cacff6 >2013-12-04 08:04:53,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a3a6970 >2013-12-04 08:04:53,432 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-17) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:04:53,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11eea505, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@caa3bb5d}, log id: 1a3a6970 >2013-12-04 08:04:58,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 187012e4 >2013-12-04 08:04:59,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 187012e4 >2013-12-04 08:04:59,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7c220269 >2013-12-04 08:04:59,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d5f5829, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75cb2f82}, log id: 7c220269 >2013-12-04 08:05:04,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a4bd94f >2013-12-04 08:05:05,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a4bd94f >2013-12-04 08:05:05,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 244d4008 >2013-12-04 08:05:05,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c46fd243, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec060733}, log id: 244d4008 >2013-12-04 08:05:10,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4253b2b3 >2013-12-04 08:05:10,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4253b2b3 >2013-12-04 08:05:10,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6267236c >2013-12-04 08:05:11,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0049948, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddc6a872}, log id: 6267236c >2013-12-04 08:05:14,603 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-1) [49406dd7] Running command: AddVdsCommand internal: false. Entities affected : ID: 70e19cf2-4ea8-40ed-b899-62a82c916654 Type: VdsGroups >2013-12-04 08:05:14,785 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-1) [563da0b8] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61 Type: VDS >2013-12-04 08:05:14,804 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-1) [563da0b8] Lock freed to object EngineLock [exclusiveLocks= key: 5849b030-626e-47cb-ad90-3ce782d831b3 value: REGISTER_VDS >, sharedLocks= ] >2013-12-04 08:05:14,804 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-1) [563da0b8] Cannot get vdsManager for vdsid=9ce61f4d-b2e2-4444-ba60-8262a9cd0e61 >2013-12-04 08:05:14,807 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [563da0b8] START, RemoveVdsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 70f3cb6c >2013-12-04 08:05:14,808 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-1) [563da0b8] Cannot get vdsManager for vdsid=9ce61f4d-b2e2-4444-ba60-8262a9cd0e61 >2013-12-04 08:05:14,808 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [563da0b8] FINISH, RemoveVdsVDSCommand, log id: 70f3cb6c >2013-12-04 08:05:14,809 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-1) [563da0b8] Cannot get vdsManager for vdsid=9ce61f4d-b2e2-4444-ba60-8262a9cd0e61 >2013-12-04 08:05:14,810 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [563da0b8] START, AddVdsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6f4455d >2013-12-04 08:05:14,811 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [563da0b8] AddVds - entered , starting logic to add VDS 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61 >2013-12-04 08:05:14,812 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [563da0b8] AddVds - VDS 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61 was added, will try to add it to the resource manager >2013-12-04 08:05:14,812 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-1) [563da0b8] Entered VdsManager constructor >2013-12-04 08:05:16,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c53efc8 >2013-12-04 08:05:16,657 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-1) [563da0b8] Initialize vdsBroker (10.70.37.147,54,321) >2013-12-04 08:05:16,672 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-1) [563da0b8] VDS 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61 was added to the Resource Manager >2013-12-04 08:05:16,672 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [563da0b8] FINISH, AddVdsVDSCommand, log id: 6f4455d >2013-12-04 08:05:16,752 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-14) [28a81807] Lock Acquired to object EngineLock [exclusiveLocks= key: 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61 value: VDS >, sharedLocks= ] >2013-12-04 08:05:16,758 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-14) [28a81807] Running command: InstallVdsCommand internal: true. Entities affected : ID: 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61 Type: VDS >2013-12-04 08:05:16,758 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-14) [28a81807] Before Installation host 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61, host4 >2013-12-04 08:05:16,764 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-14) [28a81807] START, SetVdsStatusVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61, status=Installing, nonOperationalReason=NONE), log id: 688c92fc >2013-12-04 08:05:16,766 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [563da0b8] Correlation ID: 49406dd7, Job ID: a78126a8-b665-4299-ad13-511b2c1d84ac, Call Stack: null, Custom Event ID: -1, Message: Host host4 was added by admin@internal. >2013-12-04 08:05:16,768 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-14) [28a81807] FINISH, SetVdsStatusVDSCommand, log id: 688c92fc >2013-12-04 08:05:16,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c53efc8 >2013-12-04 08:05:16,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 29e1d6c3 >2013-12-04 08:05:16,852 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-4-thread-14) [28a81807] Installation 10.70.37.147: Connected to host 10.70.37.147 with SSH key fingerprint: 1e:94:b3:c3:c5:c6:c2:71:37:47:c5:95:2e:eb:bc:f1 >2013-12-04 08:05:16,858 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-14) [28a81807] Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Connected to host 10.70.37.147 with SSH key fingerprint: 1e:94:b3:c3:c5:c6:c2:71:37:47:c5:95:2e:eb:bc:f1. >2013-12-04 08:05:16,888 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-4-thread-14) [28a81807] Installation of 10.70.37.147. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2013-12-04 08:05:17,026 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-4-thread-14) SSH execute root@10.70.37.147 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2013-12-04 08:05:17,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20c60cfe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e7eb7e0}, log id: 29e1d6c3 >2013-12-04 08:05:17,587 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-6) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:17,820 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-3) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:18,740 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Initializing >2013-12-04 08:05:18,750 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Initializing. >2013-12-04 08:05:18,778 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Environment setup >2013-12-04 08:05:18,791 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Environment setup. >2013-12-04 08:05:18,840 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Environment packages setup >2013-12-04 08:05:18,846 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Environment packages setup. >2013-12-04 08:05:19,132 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Programs detection >2013-12-04 08:05:19,139 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Programs detection. >2013-12-04 08:05:19,139 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Environment customization >2013-12-04 08:05:19,143 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Environment customization. >2013-12-04 08:05:19,195 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Logs at host located at: '/tmp/ovirt-host-deploy-20131204080517.log' >2013-12-04 08:05:19,202 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Logs at host located at: '/tmp/ovirt-host-deploy-20131204080517.log'. >2013-12-04 08:05:19,453 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-8) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:19,679 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-55) Initializing Host: host4 >2013-12-04 08:05:19,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-17) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 64e24bed >2013-12-04 08:05:20,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-17) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@3c7ce4fd, log id: 64e24bed >2013-12-04 08:05:21,134 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.70.37.147 reports unique id 2FE3B5E7-4081-A09D-81A4-CB479AEBFD6F >2013-12-04 08:05:21,137 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 2FE3B5E7-4081-A09D-81A4-CB479AEBFD6F to Host 10.70.37.147 >2013-12-04 08:05:21,294 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Setup validation >2013-12-04 08:05:21,305 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Setup validation. >2013-12-04 08:05:22,114 WARN [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Cannot validate host name settings, reason: cannot resolve own name 'rhs.4' >2013-12-04 08:05:22,128 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Host host4 installation in progress . Cannot validate host name settings, reason: cannot resolve own name 'rhs.4'. >2013-12-04 08:05:22,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a7f8b7c >2013-12-04 08:05:22,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a7f8b7c >2013-12-04 08:05:22,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 535e0d71 >2013-12-04 08:05:22,716 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Transaction setup >2013-12-04 08:05:22,724 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Transaction setup. >2013-12-04 08:05:22,758 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Misc configuration >2013-12-04 08:05:22,784 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Misc configuration. >2013-12-04 08:05:22,784 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Package installation >2013-12-04 08:05:22,840 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Package installation. >2013-12-04 08:05:22,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@faa648d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43122e07}, log id: 535e0d71 >2013-12-04 08:05:23,776 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-04 08:05:23,777 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:05:23,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70219a4c >2013-12-04 08:05:24,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [org.ovirt.engine.core.common.asynctasks.gluster.GlusterAsyncTask@6e3ab31f], log id: 70219a4c >2013-12-04 08:05:27,747 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Misc configuration >2013-12-04 08:05:27,761 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Misc configuration. >2013-12-04 08:05:27,962 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Setting time >2013-12-04 08:05:28,090 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Setting time. >2013-12-04 08:05:28,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d65982a >2013-12-04 08:05:28,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7d65982a >2013-12-04 08:05:28,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 589df7c1 >2013-12-04 08:05:29,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42edbae6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32da7cc9}, log id: 589df7c1 >2013-12-04 08:05:30,693 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:30,915 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-16) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:31,423 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Enrolling certificate >2013-12-04 08:05:31,432 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Enrolling certificate. >2013-12-04 08:05:33,124 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Transaction commit >2013-12-04 08:05:33,133 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Transaction commit. >2013-12-04 08:05:33,169 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Closing up >2013-12-04 08:05:33,180 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Closing up. >2013-12-04 08:05:33,847 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Starting gluster >2013-12-04 08:05:33,856 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Starting gluster. >2013-12-04 08:05:34,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38813210 >2013-12-04 08:05:34,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 38813210 >2013-12-04 08:05:34,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c81b29 >2013-12-04 08:05:34,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@857077b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44d82ba2}, log id: 5c81b29 >2013-12-04 08:05:36,434 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-5) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:37,802 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-14) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:37,919 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-1) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:39,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f20c514 >2013-12-04 08:05:40,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 7f20c514 >2013-12-04 08:05:40,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2428d4e4 >2013-12-04 08:05:40,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29a271d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa730de3}, log id: 2428d4e4 >2013-12-04 08:05:43,527 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-2) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:43,629 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Starting vdsm >2013-12-04 08:05:43,656 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Starting vdsm. >2013-12-04 08:05:43,657 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-17) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:45,122 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-13) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:45,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-7) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4f6538d9 >2013-12-04 08:05:45,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30e1ec98 >2013-12-04 08:05:45,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-7) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@46a159c8, log id: 4f6538d9 >2013-12-04 08:05:46,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 30e1ec98 >2013-12-04 08:05:46,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 788770d8 >2013-12-04 08:05:46,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@919910ca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@415d086a}, log id: 788770d8 >2013-12-04 08:05:48,512 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Pre-termination >2013-12-04 08:05:48,520 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Pre-termination. >2013-12-04 08:05:48,539 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20131204080548-10.70.37.147-28a81807.log' >2013-12-04 08:05:48,547 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20131204080548-10.70.37.147-28a81807.log'. >2013-12-04 08:05:48,851 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.147: Stage: Termination >2013-12-04 08:05:48,860 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28a81807, Call Stack: null, Custom Event ID: -1, Message: Installing Host host4. Stage: Termination. >2013-12-04 08:05:49,183 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-1) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:49,423 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:50,231 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-14) [28a81807] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2013-12-04 08:05:50,231 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-14) [28a81807] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2013-12-04 08:05:50,734 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-14) [28a81807] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2013-12-04 08:05:50,734 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-14) [28a81807] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2013-12-04 08:05:51,237 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-14) [28a81807] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2013-12-04 08:05:51,237 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-4-thread-14) [28a81807] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2013-12-04 08:05:51,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 65488a59 >2013-12-04 08:05:52,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65488a59 >2013-12-04 08:05:52,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 694f8128 >2013-12-04 08:05:52,863 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-4-thread-14) [28a81807] Engine managed to communicate with VDSM agent on host host4 >2013-12-04 08:05:53,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4d323a0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@626722}, log id: 694f8128 >2013-12-04 08:05:53,554 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-14) [28a81807] START, SetVdsStatusVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61, status=Initializing, nonOperationalReason=NONE), log id: 3ad11233 >2013-12-04 08:05:53,559 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-4-thread-14) [28a81807] FINISH, SetVdsStatusVDSCommand, log id: 3ad11233 >2013-12-04 08:05:53,559 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-14) [28a81807] After Installation host host4, VDS >2013-12-04 08:05:53,584 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-4-thread-14) [28a81807] Correlation ID: 28a81807, Job ID: a78126a8-b665-4299-ad13-511b2c1d84ac, Call Stack: null, Custom Event ID: -1, Message: Host host4 installed >2013-12-04 08:05:53,590 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-4-thread-14) [28a81807] Lock freed to object EngineLock [exclusiveLocks= key: 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61 value: VDS >, sharedLocks= ] >2013-12-04 08:05:53,783 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-10) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:54,814 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-13) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:54,943 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-7) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:05:55,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GetHardwareInfoVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61, vds=Host[host4]), log id: 660faab1 >2013-12-04 08:05:56,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GetHardwareInfoVDSCommand, log id: 660faab1 >2013-12-04 08:05:56,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 712a736e >2013-12-04 08:05:56,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED], log id: 712a736e >2013-12-04 08:05:56,702 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GetHardwareInfoVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61, vds=Host[host4]), log id: 7a94eb73 >2013-12-04 08:05:56,722 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GetHardwareInfoVDSCommand, log id: 7a94eb73 >2013-12-04 08:05:56,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6fb82368 >2013-12-04 08:05:57,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED], log id: 6fb82368 >2013-12-04 08:05:57,266 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host host4. >2013-12-04 08:05:57,293 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-21) [6faa4fc5] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 5849b030-626e-47cb-ad90-3ce782d831b3 Type: StoragePool >2013-12-04 08:05:57,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHostUUIDVDSCommand] (DefaultQuartzScheduler_Worker-21) [6faa4fc5] START, GetGlusterHostUUIDVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 620c6939 >2013-12-04 08:05:57,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHostUUIDVDSCommand] (DefaultQuartzScheduler_Worker-21) [6faa4fc5] FINISH, GetGlusterHostUUIDVDSCommand, return: 6435ed3e-20fe-4f0e-b672-ac28c12c7ba0, log id: 620c6939 >2013-12-04 08:05:57,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [6faa4fc5] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3e67b00f >2013-12-04 08:05:58,110 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-40) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:05:58,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [6faa4fc5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e67b00f >2013-12-04 08:05:58,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.AddGlusterServerVDSCommand] (DefaultQuartzScheduler_Worker-21) [6faa4fc5] START, AddGlusterServerVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e0eedc7 >2013-12-04 08:05:58,964 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-40) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:05:59,482 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-40) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:06:00,796 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-40) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:06:01,994 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-40) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:06:02,526 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-40) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:06:03,823 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-40) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:06:05,016 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-40) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:06:05,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.AddGlusterServerVDSCommand] (DefaultQuartzScheduler_Worker-21) [6faa4fc5] FINISH, AddGlusterServerVDSCommand, log id: 2e0eedc7 >2013-12-04 08:06:05,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36553c5f >2013-12-04 08:06:05,259 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61 Type: VDS >2013-12-04 08:06:06,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED], log id: 36553c5f >2013-12-04 08:06:06,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 33b8cfe8 >2013-12-04 08:06:06,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74ebee90, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1b97f5f}, log id: 33b8cfe8 >2013-12-04 08:06:11,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5024be93 >2013-12-04 08:06:12,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5024be93 >2013-12-04 08:06:12,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5a74327d >2013-12-04 08:06:12,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7179ff18, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@780dbca5}, log id: 5a74327d >2013-12-04 08:06:15,543 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-11) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:06:16,007 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-3) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:06:16,948 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-8) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:06:17,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5c3ddd2b >2013-12-04 08:06:17,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5c3ddd2b >2013-12-04 08:06:17,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 315ba5b7 >2013-12-04 08:06:18,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa6b2b6b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55e976d4}, log id: 315ba5b7 >2013-12-04 08:06:18,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-17) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6a224417 >2013-12-04 08:06:18,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-17) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@41057221, log id: 6a224417 >2013-12-04 08:06:23,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 73fcade1 >2013-12-04 08:06:23,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 73fcade1 >2013-12-04 08:06:23,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 29a045e0 >2013-12-04 08:06:23,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82664157, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf0b378d}, log id: 29a045e0 >2013-12-04 08:06:24,365 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [6e7f0088] No up server in cluster >2013-12-04 08:06:24,365 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [6e7f0088] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:06:24,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 77363e14 >2013-12-04 08:06:24,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterTasksListVDSCommand, return: [], log id: 77363e14 >2013-12-04 08:06:28,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c1d18c8 >2013-12-04 08:06:29,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1c1d18c8 >2013-12-04 08:06:29,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73d44ef1 >2013-12-04 08:06:29,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a42baa9e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b104e5d}, log id: 73d44ef1 >2013-12-04 08:06:31,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b1d8691 >2013-12-04 08:06:31,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@5597d90d, log id: 3b1d8691 >2013-12-04 08:06:34,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 564a901a >2013-12-04 08:06:35,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 564a901a >2013-12-04 08:06:35,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 76202e94 >2013-12-04 08:06:35,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0804497, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c504c6e}, log id: 76202e94 >2013-12-04 08:06:38,950 INFO [org.ovirt.engine.core.bll.gluster.StopRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-6) [fae9552] Running command: StopRemoveGlusterVolumeBricksCommand internal: false. Entities affected : ID: be2c16f2-a173-4bac-a979-47cf211a97e3 Type: GlusterVolume >2013-12-04 08:06:38,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.StopRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-6) [fae9552] START, StopRemoveGlusterVolumeBricksVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 46e6a45a >2013-12-04 08:06:40,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.StopRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-6) [fae9552] FINISH, StopRemoveGlusterVolumeBricksVDSCommand, log id: 46e6a45a >2013-12-04 08:06:40,030 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (ajp-/127.0.0.1:8702-6) [fae9552] Trying to release exclusive lock which does not exist, lock key: be2c16f2-a173-4bac-a979-47cf211a97e3GLUSTER >2013-12-04 08:06:40,030 INFO [org.ovirt.engine.core.bll.gluster.StopRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-6) [fae9552] Lock freed to object EngineLock [exclusiveLocks= key: be2c16f2-a173-4bac-a979-47cf211a97e3 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:06:40,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e09bfac >2013-12-04 08:06:41,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e09bfac >2013-12-04 08:06:41,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1756b99b >2013-12-04 08:06:41,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@162f8859, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d41cabb}, log id: 1756b99b >2013-12-04 08:06:45,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-14) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 61af963 >2013-12-04 08:06:45,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-14) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@6d2c1cd6, log id: 61af963 >2013-12-04 08:06:46,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1cad0db9 >2013-12-04 08:06:46,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1cad0db9 >2013-12-04 08:06:46,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 500a62f9 >2013-12-04 08:06:47,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a19ce2e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d2b40eb}, log id: 500a62f9 >2013-12-04 08:06:48,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6fff5346 >2013-12-04 08:06:48,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-12) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@28407818, log id: 6fff5346 >2013-12-04 08:06:52,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43b09f4c >2013-12-04 08:06:52,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 43b09f4c >2013-12-04 08:06:52,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a3bfb98 >2013-12-04 08:06:53,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f3fd8f6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5f9caa7}, log id: 6a3bfb98 >2013-12-04 08:06:58,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a17997e >2013-12-04 08:06:58,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6a17997e >2013-12-04 08:06:58,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: a0740d0 >2013-12-04 08:06:58,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a97f8e38, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44adc263}, log id: a0740d0 >2013-12-04 08:07:03,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e478a49 >2013-12-04 08:07:04,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e478a49 >2013-12-04 08:07:04,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 446f25b2 >2013-12-04 08:07:04,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74cec1bf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@472b7012}, log id: 446f25b2 >2013-12-04 08:07:07,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-5) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 43076642 >2013-12-04 08:07:07,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-5) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@4c993640, log id: 43076642 >2013-12-04 08:07:09,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3547a773 >2013-12-04 08:07:10,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3547a773 >2013-12-04 08:07:10,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 68da6693 >2013-12-04 08:07:10,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90d86e73, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8eb16b2e}, log id: 68da6693 >2013-12-04 08:07:15,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63991663 >2013-12-04 08:07:16,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 63991663 >2013-12-04 08:07:16,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 744d68a7 >2013-12-04 08:07:16,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c0a3d33, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4db1b8c}, log id: 744d68a7 >2013-12-04 08:07:21,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75cdde66 >2013-12-04 08:07:22,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 75cdde66 >2013-12-04 08:07:22,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25842088 >2013-12-04 08:07:22,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86b00111, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b025a2a}, log id: 25842088 >2013-12-04 08:07:23,324 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:07:23,590 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-16) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:07:24,994 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-04 08:07:24,994 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:07:25,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 785b57db >2013-12-04 08:07:25,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 785b57db >2013-12-04 08:07:27,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 428f3ed0 >2013-12-04 08:07:28,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 428f3ed0 >2013-12-04 08:07:28,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 906d5b8 >2013-12-04 08:07:28,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9990b852, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a73f912d}, log id: 906d5b8 >2013-12-04 08:07:33,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4438d3af >2013-12-04 08:07:34,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4438d3af >2013-12-04 08:07:34,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4cf07d76 >2013-12-04 08:07:34,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8c625a1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@702ed654}, log id: 4cf07d76 >2013-12-04 08:07:39,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 213bcb25 >2013-12-04 08:07:39,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 213bcb25 >2013-12-04 08:07:39,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e24057c >2013-12-04 08:07:40,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6de672, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b4bc338}, log id: 2e24057c >2013-12-04 08:07:45,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 26ddbdfc >2013-12-04 08:07:45,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 26ddbdfc >2013-12-04 08:07:45,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 287d521c >2013-12-04 08:07:46,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1f74821, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a29df31f}, log id: 287d521c >2013-12-04 08:07:51,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 59243e8a >2013-12-04 08:07:51,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 59243e8a >2013-12-04 08:07:51,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4f122361 >2013-12-04 08:07:51,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2aa3690, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@628749b0}, log id: 4f122361 >2013-12-04 08:07:56,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c12790f >2013-12-04 08:07:57,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1c12790f >2013-12-04 08:07:57,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1ac75c10 >2013-12-04 08:07:57,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5f84361, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee6a3380}, log id: 1ac75c10 >2013-12-04 08:08:02,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 549b30f1 >2013-12-04 08:08:03,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 549b30f1 >2013-12-04 08:08:03,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40079c2c >2013-12-04 08:08:03,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f104bfeb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a1f01f2}, log id: 40079c2c >2013-12-04 08:08:08,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3bba9fb1 >2013-12-04 08:08:09,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bba9fb1 >2013-12-04 08:08:09,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 10d10cd8 >2013-12-04 08:08:09,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3ccf2f6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe320547}, log id: 10d10cd8 >2013-12-04 08:08:14,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 30e08364 >2013-12-04 08:08:15,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 30e08364 >2013-12-04 08:08:15,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 101a20b6 >2013-12-04 08:08:15,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dff5cecf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da173c39}, log id: 101a20b6 >2013-12-04 08:08:20,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 461ed3b3 >2013-12-04 08:08:20,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 461ed3b3 >2013-12-04 08:08:20,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b93930 >2013-12-04 08:08:21,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26280696, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b1ecc1}, log id: 2b93930 >2013-12-04 08:08:25,317 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) No up server in cluster >2013-12-04 08:08:25,318 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:08:25,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c938f04 >2013-12-04 08:08:25,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2c938f04 >2013-12-04 08:08:26,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e5e3e48 >2013-12-04 08:08:26,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6e5e3e48 >2013-12-04 08:08:26,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9a871df >2013-12-04 08:08:26,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa0a0714, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa43abfc}, log id: 9a871df >2013-12-04 08:08:31,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24edb27b >2013-12-04 08:08:32,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 24edb27b >2013-12-04 08:08:32,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6d5943de >2013-12-04 08:08:32,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baf7983e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18963c82}, log id: 6d5943de >2013-12-04 08:08:37,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 49a6ceaa >2013-12-04 08:08:38,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 49a6ceaa >2013-12-04 08:08:38,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2f7ecfb3 >2013-12-04 08:08:38,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1118c6f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50d4097b}, log id: 2f7ecfb3 >2013-12-04 08:08:43,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3a013534 >2013-12-04 08:08:44,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a013534 >2013-12-04 08:08:44,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1d026510 >2013-12-04 08:08:44,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df608445, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@552a997d}, log id: 1d026510 >2013-12-04 08:08:49,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f27ac30 >2013-12-04 08:08:50,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5f27ac30 >2013-12-04 08:08:50,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e8b2bdd >2013-12-04 08:08:50,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc42a71f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aad15ad4}, log id: 7e8b2bdd >2013-12-04 08:08:55,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 56c7e923 >2013-12-04 08:08:55,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 56c7e923 >2013-12-04 08:08:55,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6a941d6 >2013-12-04 08:08:56,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7509d89e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88db6a80}, log id: 6a941d6 >2013-12-04 08:09:01,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6163059b >2013-12-04 08:09:01,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6163059b >2013-12-04 08:09:01,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ab18f2f >2013-12-04 08:09:02,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5085034, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bf1c3b5}, log id: 7ab18f2f >2013-12-04 08:09:07,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: a19f784 >2013-12-04 08:09:07,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: a19f784 >2013-12-04 08:09:07,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 23feb560 >2013-12-04 08:09:07,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6add093, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@497ee61c}, log id: 23feb560 >2013-12-04 08:09:12,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7276e4e7 >2013-12-04 08:09:13,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7276e4e7 >2013-12-04 08:09:13,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 32d09e4f >2013-12-04 08:09:13,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@216b9370, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@984cb75e}, log id: 32d09e4f >2013-12-04 08:09:18,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5897375c >2013-12-04 08:09:19,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5897375c >2013-12-04 08:09:19,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 13be999f >2013-12-04 08:09:19,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65fa1372, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@962c4509}, log id: 13be999f >2013-12-04 08:09:22,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b6942c6 >2013-12-04 08:09:23,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@758770c3, log id: 4b6942c6 >2013-12-04 08:09:23,105 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-39) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:09:23,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: efc4e7d >2013-12-04 08:09:23,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3b4397c3, log id: efc4e7d >2013-12-04 08:09:23,417 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-39) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected change in status of brick 10.70.37.74:/rhs/brick1/b1 of volume dis_vol from DOWN to UP. >2013-12-04 08:09:24,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5725335 >2013-12-04 08:09:25,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5725335 >2013-12-04 08:09:25,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 767c13a8 >2013-12-04 08:09:25,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0b086b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9ca4da3}, log id: 767c13a8 >2013-12-04 08:09:25,671 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) [5be76bf9] No up server in cluster >2013-12-04 08:09:25,671 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) [5be76bf9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:09:25,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d730fdf >2013-12-04 08:09:25,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4d730fdf >2013-12-04 08:09:30,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41447d0b >2013-12-04 08:09:31,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 41447d0b >2013-12-04 08:09:31,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3324103e >2013-12-04 08:09:31,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dfae370, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53050592}, log id: 3324103e >2013-12-04 08:09:36,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 792e4e1e >2013-12-04 08:09:36,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 792e4e1e >2013-12-04 08:09:36,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e335255 >2013-12-04 08:09:37,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dfaa51d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@102d4bc3}, log id: e335255 >2013-12-04 08:09:42,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 638d3c94 >2013-12-04 08:09:42,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 638d3c94 >2013-12-04 08:09:42,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 516e0c5f >2013-12-04 08:09:43,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d8111c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@daaa4d4}, log id: 516e0c5f >2013-12-04 08:09:48,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6e09ba4b >2013-12-04 08:09:48,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6e09ba4b >2013-12-04 08:09:48,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 312aedd9 >2013-12-04 08:09:48,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c145a81, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff296eab}, log id: 312aedd9 >2013-12-04 08:09:53,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ae9f57f >2013-12-04 08:09:54,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1ae9f57f >2013-12-04 08:09:54,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ad6867d >2013-12-04 08:09:54,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ebb3092, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b86d521}, log id: 3ad6867d >2013-12-04 08:09:59,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 33f0153 >2013-12-04 08:10:00,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 33f0153 >2013-12-04 08:10:00,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 52dc4ee7 >2013-12-04 08:10:00,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a64eec77, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c5ca1cb}, log id: 52dc4ee7 >2013-12-04 08:10:05,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 57089eff >2013-12-04 08:10:06,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 57089eff >2013-12-04 08:10:06,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6ca4f631 >2013-12-04 08:10:06,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6641c5c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45c843e}, log id: 6ca4f631 >2013-12-04 08:10:11,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 532d2460 >2013-12-04 08:10:12,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 532d2460 >2013-12-04 08:10:12,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4277c909 >2013-12-04 08:10:12,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@440efffc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1265702}, log id: 4277c909 >2013-12-04 08:10:17,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 501dce6a >2013-12-04 08:10:17,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 501dce6a >2013-12-04 08:10:17,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7859d11f >2013-12-04 08:10:18,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8df471a2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0556ed}, log id: 7859d11f >2013-12-04 08:10:23,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 406cacea >2013-12-04 08:10:23,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 406cacea >2013-12-04 08:10:23,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15a252ef >2013-12-04 08:10:24,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da21019f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb9c5847}, log id: 15a252ef >2013-12-04 08:10:25,982 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-53) No up server in cluster >2013-12-04 08:10:25,983 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-53) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:10:26,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e5ff5cb >2013-12-04 08:10:26,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6e5ff5cb >2013-12-04 08:10:29,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67b08bd9 >2013-12-04 08:10:29,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 67b08bd9 >2013-12-04 08:10:29,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2f3f3c9a >2013-12-04 08:10:29,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47455e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5a9325d}, log id: 2f3f3c9a >2013-12-04 08:10:34,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: a8f07d7 >2013-12-04 08:10:35,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: a8f07d7 >2013-12-04 08:10:35,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5086b679 >2013-12-04 08:10:35,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54126001, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c3f1a38}, log id: 5086b679 >2013-12-04 08:10:40,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ee9465e >2013-12-04 08:10:41,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4ee9465e >2013-12-04 08:10:41,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6706313c >2013-12-04 08:10:41,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e8c9fe8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9da584a6}, log id: 6706313c >2013-12-04 08:10:46,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 254e5420 >2013-12-04 08:10:47,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 254e5420 >2013-12-04 08:10:47,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 40ce6159 >2013-12-04 08:10:47,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3390ab79, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d414879}, log id: 40ce6159 >2013-12-04 08:10:52,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 402cddb >2013-12-04 08:10:52,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 402cddb >2013-12-04 08:10:52,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 72e2ede >2013-12-04 08:10:53,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@781697fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1082a8a9}, log id: 72e2ede >2013-12-04 08:10:58,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3bec7e19 >2013-12-04 08:10:58,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3bec7e19 >2013-12-04 08:10:58,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47393cce >2013-12-04 08:10:59,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1229e6ce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42b09d5}, log id: 47393cce >2013-12-04 08:11:04,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e349787 >2013-12-04 08:11:04,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6e349787 >2013-12-04 08:11:04,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: bc5893b >2013-12-04 08:11:04,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e5c2b18, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a5291f5}, log id: bc5893b >2013-12-04 08:11:09,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5794466a >2013-12-04 08:11:10,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5794466a >2013-12-04 08:11:10,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ed74818 >2013-12-04 08:11:10,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60b1169a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79417547}, log id: 1ed74818 >2013-12-04 08:11:16,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ff23e88 >2013-12-04 08:11:16,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7ff23e88 >2013-12-04 08:11:16,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17cee3e1 >2013-12-04 08:11:17,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8055bcb3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8960788c}, log id: 17cee3e1 >2013-12-04 08:11:22,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5a8a84ad >2013-12-04 08:11:22,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5a8a84ad >2013-12-04 08:11:22,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6488b018 >2013-12-04 08:11:22,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1a9842d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b424d85}, log id: 6488b018 >2013-12-04 08:11:26,296 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-04 08:11:26,297 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:11:26,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26b25311 >2013-12-04 08:11:26,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 26b25311 >2013-12-04 08:11:27,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6f528f4 >2013-12-04 08:11:28,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f528f4 >2013-12-04 08:11:28,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5bf06e92 >2013-12-04 08:11:28,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e551c966, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@482d586f}, log id: 5bf06e92 >2013-12-04 08:11:33,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 636f3d08 >2013-12-04 08:11:34,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 636f3d08 >2013-12-04 08:11:34,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6d002d5f >2013-12-04 08:11:34,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1746a390, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e04faa06}, log id: 6d002d5f >2013-12-04 08:11:39,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c5da93a >2013-12-04 08:11:39,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3c5da93a >2013-12-04 08:11:39,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2a90a1ef >2013-12-04 08:11:40,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@574cf800, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95028773}, log id: 2a90a1ef >2013-12-04 08:11:45,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5fd1a8e2 >2013-12-04 08:11:45,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5fd1a8e2 >2013-12-04 08:11:45,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2d0b5c7d >2013-12-04 08:11:45,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16ff1d06, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86452fd7}, log id: 2d0b5c7d >2013-12-04 08:11:51,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76deff18 >2013-12-04 08:11:51,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 76deff18 >2013-12-04 08:11:51,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f2b9f4d >2013-12-04 08:11:51,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd556fa8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@517cf735}, log id: 5f2b9f4d >2013-12-04 08:11:56,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 543c8f34 >2013-12-04 08:11:57,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 543c8f34 >2013-12-04 08:11:57,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7d2e3d73 >2013-12-04 08:11:57,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21cb5788, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b50c312}, log id: 7d2e3d73 >2013-12-04 08:12:02,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6834440b >2013-12-04 08:12:03,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6834440b >2013-12-04 08:12:03,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 16c05262 >2013-12-04 08:12:03,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee0e4a6c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b90e7c7d}, log id: 16c05262 >2013-12-04 08:12:08,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ef448c1 >2013-12-04 08:12:08,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6ef448c1 >2013-12-04 08:12:08,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 201bf62e >2013-12-04 08:12:09,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@750c2ddd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5bc8d7e}, log id: 201bf62e >2013-12-04 08:12:14,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 39cabd42 >2013-12-04 08:12:14,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 39cabd42 >2013-12-04 08:12:14,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7c3d5fb5 >2013-12-04 08:12:14,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0acfe3b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d3ec0b5}, log id: 7c3d5fb5 >2013-12-04 08:12:19,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d82f447 >2013-12-04 08:12:20,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3d82f447 >2013-12-04 08:12:20,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4bc85062 >2013-12-04 08:12:20,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91997c9c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f41ca3e5}, log id: 4bc85062 >2013-12-04 08:12:25,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2314c12e >2013-12-04 08:12:26,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2314c12e >2013-12-04 08:12:26,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12085131 >2013-12-04 08:12:26,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf6e721a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc4b29eb}, log id: 12085131 >2013-12-04 08:12:26,593 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-7) No up server in cluster >2013-12-04 08:12:26,593 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-7) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:12:26,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7233251b >2013-12-04 08:12:26,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7233251b >2013-12-04 08:12:31,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10fd5e18 >2013-12-04 08:12:31,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 10fd5e18 >2013-12-04 08:12:31,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39dddf72 >2013-12-04 08:12:32,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d21c900f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec01db53}, log id: 39dddf72 >2013-12-04 08:12:37,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: dbc3f04 >2013-12-04 08:12:37,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: dbc3f04 >2013-12-04 08:12:37,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8948ffd >2013-12-04 08:12:38,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9544b30, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddac8b8b}, log id: 8948ffd >2013-12-04 08:12:43,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f61f9c6 >2013-12-04 08:12:43,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: f61f9c6 >2013-12-04 08:12:43,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e26b531 >2013-12-04 08:12:43,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58ae2f52, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d65833f}, log id: e26b531 >2013-12-04 08:12:48,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 727f39e8 >2013-12-04 08:12:49,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 727f39e8 >2013-12-04 08:12:49,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3f2a26f4 >2013-12-04 08:12:49,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@737d26eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de49e93c}, log id: 3f2a26f4 >2013-12-04 08:12:54,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ba7798c >2013-12-04 08:12:55,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: ba7798c >2013-12-04 08:12:55,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5c0d6a6b >2013-12-04 08:12:55,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@598848e5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec56a259}, log id: 5c0d6a6b >2013-12-04 08:13:00,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4916319a >2013-12-04 08:13:01,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4916319a >2013-12-04 08:13:01,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4c8ba951 >2013-12-04 08:13:01,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0f501bd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ee59452}, log id: 4c8ba951 >2013-12-04 08:13:06,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 52bed565 >2013-12-04 08:13:06,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 52bed565 >2013-12-04 08:13:06,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 10b98193 >2013-12-04 08:13:07,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ff3ab30, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f84d5cf}, log id: 10b98193 >2013-12-04 08:13:12,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 62aa6201 >2013-12-04 08:13:12,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 62aa6201 >2013-12-04 08:13:12,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 35412cff >2013-12-04 08:13:12,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44f5353c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95d4b575}, log id: 35412cff >2013-12-04 08:13:17,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 74b54105 >2013-12-04 08:13:18,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 74b54105 >2013-12-04 08:13:18,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1a65101d >2013-12-04 08:13:18,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9115de9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c192382}, log id: 1a65101d >2013-12-04 08:13:23,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 473a8713 >2013-12-04 08:13:24,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 473a8713 >2013-12-04 08:13:24,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2f59c2ab >2013-12-04 08:13:24,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@383e09f6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@927c662c}, log id: 2f59c2ab >2013-12-04 08:13:26,908 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) No up server in cluster >2013-12-04 08:13:26,908 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:13:26,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5768ff42 >2013-12-04 08:13:27,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5768ff42 >2013-12-04 08:13:29,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14d179b2 >2013-12-04 08:13:30,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 14d179b2 >2013-12-04 08:13:30,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 743370c3 >2013-12-04 08:13:30,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8164fc0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b521751b}, log id: 743370c3 >2013-12-04 08:13:35,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 79e807e1 >2013-12-04 08:13:35,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 79e807e1 >2013-12-04 08:13:35,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 13911117 >2013-12-04 08:13:36,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56d97ec0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aeb8aedc}, log id: 13911117 >2013-12-04 08:13:41,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d8fad14 >2013-12-04 08:13:41,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4d8fad14 >2013-12-04 08:13:41,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6a961811 >2013-12-04 08:13:41,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98773eeb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33ffd9a4}, log id: 6a961811 >2013-12-04 08:13:44,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-1) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 47f7a69b >2013-12-04 08:13:44,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-1) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@49ddec33, log id: 47f7a69b >2013-12-04 08:13:47,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 35818d24 >2013-12-04 08:13:47,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 35818d24 >2013-12-04 08:13:47,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3cb368d6 >2013-12-04 08:13:47,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@445d75d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c03181b}, log id: 3cb368d6 >2013-12-04 08:13:52,513 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-7) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:13:52,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43611018 >2013-12-04 08:13:52,811 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-6) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:13:53,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 43611018 >2013-12-04 08:13:53,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 74a4854c >2013-12-04 08:13:53,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c7de771, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e11c440}, log id: 74a4854c >2013-12-04 08:13:54,755 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-13) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:13:54,865 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-10) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 08:13:58,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3a97a522 >2013-12-04 08:13:59,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a97a522 >2013-12-04 08:13:59,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6a1bfd42 >2013-12-04 08:13:59,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40d50d81, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19aa4a7b}, log id: 6a1bfd42 >2013-12-04 08:14:04,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b0cf812 >2013-12-04 08:14:05,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: b0cf812 >2013-12-04 08:14:05,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29fc1172 >2013-12-04 08:14:05,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e96e86f6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4876a3c}, log id: 29fc1172 >2013-12-04 08:14:10,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6b31f98 >2013-12-04 08:14:10,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b31f98 >2013-12-04 08:14:10,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5a9c833 >2013-12-04 08:14:11,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74db6fef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@286ecd96}, log id: 5a9c833 >2013-12-04 08:14:16,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5fe6dcd1 >2013-12-04 08:14:16,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5fe6dcd1 >2013-12-04 08:14:16,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 570f166e >2013-12-04 08:14:16,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e5a924, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd3f6da8}, log id: 570f166e >2013-12-04 08:14:21,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 73e9ccfe >2013-12-04 08:14:22,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 73e9ccfe >2013-12-04 08:14:22,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 62a18669 >2013-12-04 08:14:22,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e051f0c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@917248c6}, log id: 62a18669 >2013-12-04 08:14:23,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2104987a >2013-12-04 08:14:23,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4409d2dc, log id: 2104987a >2013-12-04 08:14:23,739 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-28) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:14:23,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 60f28c69 >2013-12-04 08:14:24,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@719cc011, log id: 60f28c69 >2013-12-04 08:14:27,218 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-04 08:14:27,218 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:14:27,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 64202b4a >2013-12-04 08:14:27,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [], log id: 64202b4a >2013-12-04 08:14:27,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48135c92 >2013-12-04 08:14:28,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 48135c92 >2013-12-04 08:14:28,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 772667f4 >2013-12-04 08:14:28,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad814ae0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82b698c8}, log id: 772667f4 >2013-12-04 08:14:33,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d07bf7e >2013-12-04 08:14:34,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1d07bf7e >2013-12-04 08:14:34,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2a72777a >2013-12-04 08:14:34,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@464b64c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81eaa688}, log id: 2a72777a >2013-12-04 08:14:39,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d1c40ee >2013-12-04 08:14:39,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3d1c40ee >2013-12-04 08:14:39,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4eb274f7 >2013-12-04 08:14:40,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9a4643b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfd73c38}, log id: 4eb274f7 >2013-12-04 08:14:45,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ee7da82 >2013-12-04 08:14:45,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1ee7da82 >2013-12-04 08:14:45,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b099ccd >2013-12-04 08:14:46,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6301da3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2326b4a4}, log id: 2b099ccd >2013-12-04 08:14:51,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 72c889b1 >2013-12-04 08:14:51,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 72c889b1 >2013-12-04 08:14:51,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 48eac7e9 >2013-12-04 08:14:51,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9dbbf3e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bb45f22}, log id: 48eac7e9 >2013-12-04 08:14:56,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: fbbd924 >2013-12-04 08:14:57,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: fbbd924 >2013-12-04 08:14:57,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d93beca >2013-12-04 08:14:57,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b36c7899, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba538692}, log id: 4d93beca >2013-12-04 08:15:02,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 762720db >2013-12-04 08:15:03,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 762720db >2013-12-04 08:15:03,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 77c8a14b >2013-12-04 08:15:03,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@265a70b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6b56f2a}, log id: 77c8a14b >2013-12-04 08:15:08,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39cd90b1 >2013-12-04 08:15:09,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 39cd90b1 >2013-12-04 08:15:09,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 304a0a5e >2013-12-04 08:15:09,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9fd8f3c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75cdcd67}, log id: 304a0a5e >2013-12-04 08:15:14,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 772f0943 >2013-12-04 08:15:14,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 772f0943 >2013-12-04 08:15:14,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 338d1b70 >2013-12-04 08:15:15,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c16969de, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df0924a8}, log id: 338d1b70 >2013-12-04 08:15:20,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 72098e41 >2013-12-04 08:15:20,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 72098e41 >2013-12-04 08:15:20,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2bf97d7d >2013-12-04 08:15:21,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb911531, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@518f2538}, log id: 2bf97d7d >2013-12-04 08:15:26,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70656114 >2013-12-04 08:15:26,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 70656114 >2013-12-04 08:15:26,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32fa8895 >2013-12-04 08:15:26,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c2a9e32, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7028d7f2}, log id: 32fa8895 >2013-12-04 08:15:27,635 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [6e7f0088] No up server in cluster >2013-12-04 08:15:27,635 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [6e7f0088] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:15:27,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4fd8fc42 >2013-12-04 08:15:27,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4fd8fc42 >2013-12-04 08:15:31,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e88a3ec >2013-12-04 08:15:32,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3e88a3ec >2013-12-04 08:15:32,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1e9e769c >2013-12-04 08:15:32,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a43b7c57, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b98270d0}, log id: 1e9e769c >2013-12-04 08:15:37,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 72de9e83 >2013-12-04 08:15:38,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 72de9e83 >2013-12-04 08:15:38,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5ef13347 >2013-12-04 08:15:38,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c25a195, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fae2243}, log id: 5ef13347 >2013-12-04 08:15:43,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6aafecdf >2013-12-04 08:15:43,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6aafecdf >2013-12-04 08:15:43,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3366a7f0 >2013-12-04 08:15:44,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f34744d2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5106922}, log id: 3366a7f0 >2013-12-04 08:15:49,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70284214 >2013-12-04 08:15:49,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 70284214 >2013-12-04 08:15:49,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5bba9aab >2013-12-04 08:15:49,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a62e338d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5db5256}, log id: 5bba9aab >2013-12-04 08:15:54,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2aeaa67d >2013-12-04 08:15:55,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2aeaa67d >2013-12-04 08:15:55,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 193c793c >2013-12-04 08:15:55,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fb80b5d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2542d7b1}, log id: 193c793c >2013-12-04 08:16:00,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a802976 >2013-12-04 08:16:01,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a802976 >2013-12-04 08:16:01,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 694dec2f >2013-12-04 08:16:01,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@142f7f79, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ce101a5}, log id: 694dec2f >2013-12-04 08:16:06,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 14fd27c1 >2013-12-04 08:16:06,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 14fd27c1 >2013-12-04 08:16:06,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78ae447f >2013-12-04 08:16:07,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6de3b98, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2370412}, log id: 78ae447f >2013-12-04 08:16:12,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 70aa869f >2013-12-04 08:16:12,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 70aa869f >2013-12-04 08:16:12,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 132b0198 >2013-12-04 08:16:13,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e604d288, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46327401}, log id: 132b0198 >2013-12-04 08:16:18,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16c4336 >2013-12-04 08:16:18,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 16c4336 >2013-12-04 08:16:18,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4dcf1bef >2013-12-04 08:16:18,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70e23a01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21f9d89a}, log id: 4dcf1bef >2013-12-04 08:16:23,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 30ff7b9d >2013-12-04 08:16:24,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 30ff7b9d >2013-12-04 08:16:24,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 11a49d1c >2013-12-04 08:16:24,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@102833e7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfa4a781}, log id: 11a49d1c >2013-12-04 08:16:27,939 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) No up server in cluster >2013-12-04 08:16:27,939 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:16:27,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 73cbd2ad >2013-12-04 08:16:28,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, return: [], log id: 73cbd2ad >2013-12-04 08:16:29,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b6844f3 >2013-12-04 08:16:30,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b6844f3 >2013-12-04 08:16:30,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 60cf521a >2013-12-04 08:16:30,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ec5a7af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc2cf4e8}, log id: 60cf521a >2013-12-04 08:16:35,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21175105 >2013-12-04 08:16:35,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 21175105 >2013-12-04 08:16:35,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55dfe945 >2013-12-04 08:16:36,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa131f5a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28ca53eb}, log id: 55dfe945 >2013-12-04 08:16:41,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3fcdae1c >2013-12-04 08:16:41,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3fcdae1c >2013-12-04 08:16:41,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5709ca3f >2013-12-04 08:16:41,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69d3ac5f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@712b21f1}, log id: 5709ca3f >2013-12-04 08:16:46,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5665fd19 >2013-12-04 08:16:47,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5665fd19 >2013-12-04 08:16:47,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 204797a9 >2013-12-04 08:16:47,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9f235e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d1059f6}, log id: 204797a9 >2013-12-04 08:16:52,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6703bca6 >2013-12-04 08:16:53,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6703bca6 >2013-12-04 08:16:53,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6fea48e8 >2013-12-04 08:16:53,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6390f9bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e593e97}, log id: 6fea48e8 >2013-12-04 08:16:58,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 601ddfe1 >2013-12-04 08:16:59,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 601ddfe1 >2013-12-04 08:16:59,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5633699d >2013-12-04 08:16:59,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e0551e2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8da8944}, log id: 5633699d >2013-12-04 08:17:04,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 15b4fd7b >2013-12-04 08:17:04,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 15b4fd7b >2013-12-04 08:17:04,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5cbcbb1a >2013-12-04 08:17:05,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@733e1061, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cf2d7d3}, log id: 5cbcbb1a >2013-12-04 08:17:10,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43ca6081 >2013-12-04 08:17:10,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 43ca6081 >2013-12-04 08:17:10,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5ce098d3 >2013-12-04 08:17:10,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@417a2415, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69db4a43}, log id: 5ce098d3 >2013-12-04 08:17:15,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78a02dc8 >2013-12-04 08:17:16,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 78a02dc8 >2013-12-04 08:17:16,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27bda5bc >2013-12-04 08:17:16,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@116ff191, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4849982}, log id: 27bda5bc >2013-12-04 08:17:21,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 654e80c8 >2013-12-04 08:17:22,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 654e80c8 >2013-12-04 08:17:22,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4909e7cc >2013-12-04 08:17:22,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b498e6b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@facc8a9c}, log id: 4909e7cc >2013-12-04 08:17:27,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 386d84eb >2013-12-04 08:17:27,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 386d84eb >2013-12-04 08:17:27,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 54f6323d >2013-12-04 08:17:28,234 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-04 08:17:28,234 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:17:28,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5898de43 >2013-12-04 08:17:28,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddb590ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5846dbfb}, log id: 54f6323d >2013-12-04 08:17:28,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5898de43 >2013-12-04 08:17:33,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4598f997 >2013-12-04 08:17:33,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4598f997 >2013-12-04 08:17:33,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 65bfcf6e >2013-12-04 08:17:34,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2389ba6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8deac52}, log id: 65bfcf6e >2013-12-04 08:17:39,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ebe1118 >2013-12-04 08:17:39,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6ebe1118 >2013-12-04 08:17:39,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f50266 >2013-12-04 08:17:39,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f79a1e5a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7d2aa6f}, log id: 4f50266 >2013-12-04 08:17:44,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d09cf9e >2013-12-04 08:17:45,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: d09cf9e >2013-12-04 08:17:45,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3392a556 >2013-12-04 08:17:45,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f83fbd58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad8120aa}, log id: 3392a556 >2013-12-04 08:17:50,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ca9bdfb >2013-12-04 08:17:51,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6ca9bdfb >2013-12-04 08:17:51,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40d7fc7e >2013-12-04 08:17:51,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c63d69ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7a725e6}, log id: 40d7fc7e >2013-12-04 08:17:56,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12938c >2013-12-04 08:17:56,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 12938c >2013-12-04 08:17:56,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5771e542 >2013-12-04 08:17:57,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c53aa42, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f40b638c}, log id: 5771e542 >2013-12-04 08:18:02,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57c6f5f2 >2013-12-04 08:18:02,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 57c6f5f2 >2013-12-04 08:18:02,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27dc59d5 >2013-12-04 08:18:03,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27794593, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dce7f552}, log id: 27dc59d5 >2013-12-04 08:18:08,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 300024b0 >2013-12-04 08:18:08,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 300024b0 >2013-12-04 08:18:08,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27e5a9d8 >2013-12-04 08:18:08,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38dc97be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33121ea0}, log id: 27e5a9d8 >2013-12-04 08:18:13,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4f836e0e >2013-12-04 08:18:14,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4f836e0e >2013-12-04 08:18:14,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: c0783b >2013-12-04 08:18:14,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10839556, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d72b9e0}, log id: c0783b >2013-12-04 08:18:19,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 500d26d3 >2013-12-04 08:18:20,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 500d26d3 >2013-12-04 08:18:20,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 425db51d >2013-12-04 08:18:20,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0314dda, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c638810}, log id: 425db51d >2013-12-04 08:18:25,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 743559f2 >2013-12-04 08:18:25,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 743559f2 >2013-12-04 08:18:25,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40c8f500 >2013-12-04 08:18:26,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4772cd0c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28f77859}, log id: 40c8f500 >2013-12-04 08:18:28,527 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-04 08:18:28,527 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:18:28,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57ca456a >2013-12-04 08:18:28,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [], log id: 57ca456a >2013-12-04 08:18:31,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40b79176 >2013-12-04 08:18:31,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 40b79176 >2013-12-04 08:18:31,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ba40d8d >2013-12-04 08:18:31,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ad97d3e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e207a5ba}, log id: 2ba40d8d >2013-12-04 08:18:36,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14042f2b >2013-12-04 08:18:37,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 14042f2b >2013-12-04 08:18:37,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4603402a >2013-12-04 08:18:37,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5abf7a1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6235ae}, log id: 4603402a >2013-12-04 08:18:42,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3d2527e1 >2013-12-04 08:18:43,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d2527e1 >2013-12-04 08:18:43,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 46294950 >2013-12-04 08:18:43,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fdc0417, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0bf3493}, log id: 46294950 >2013-12-04 08:18:48,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24fda92e >2013-12-04 08:18:49,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 24fda92e >2013-12-04 08:18:49,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: bda699d >2013-12-04 08:18:49,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10d6e1d0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96d1db9e}, log id: bda699d >2013-12-04 08:18:54,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5c4efb11 >2013-12-04 08:18:54,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5c4efb11 >2013-12-04 08:18:54,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6a7d7798 >2013-12-04 08:18:55,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1186807, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8edbcb05}, log id: 6a7d7798 >2013-12-04 08:19:00,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3bc3e07a >2013-12-04 08:19:00,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3bc3e07a >2013-12-04 08:19:00,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d653dbd >2013-12-04 08:19:00,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e65e02f1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e3bb273}, log id: 3d653dbd >2013-12-04 08:19:05,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 76ad6e8b >2013-12-04 08:19:06,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 76ad6e8b >2013-12-04 08:19:06,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d63190f >2013-12-04 08:19:06,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d20e18a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@551b005d}, log id: 7d63190f >2013-12-04 08:19:11,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4b7c6850 >2013-12-04 08:19:12,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4b7c6850 >2013-12-04 08:19:12,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4690bf9d >2013-12-04 08:19:12,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77968779, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46582cbc}, log id: 4690bf9d >2013-12-04 08:19:17,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2cd2f6db >2013-12-04 08:19:17,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2cd2f6db >2013-12-04 08:19:17,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 64bb26a5 >2013-12-04 08:19:18,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24dd136f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca3a58c9}, log id: 64bb26a5 >2013-12-04 08:19:23,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 713c5308 >2013-12-04 08:19:23,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 713c5308 >2013-12-04 08:19:23,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19b97af1 >2013-12-04 08:19:23,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d568617e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5d29cb8}, log id: 19b97af1 >2013-12-04 08:19:24,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e7eb790 >2013-12-04 08:19:24,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5d60d01b, log id: 5e7eb790 >2013-12-04 08:19:24,307 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-12) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:19:24,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7efecc81 >2013-12-04 08:19:24,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4a4ca292, log id: 7efecc81 >2013-12-04 08:19:28,834 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-04 08:19:28,834 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:19:28,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5d607490 >2013-12-04 08:19:29,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 53012308 >2013-12-04 08:19:29,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5d607490 >2013-12-04 08:19:29,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 53012308 >2013-12-04 08:19:29,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2483f160 >2013-12-04 08:19:29,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4b2c9e7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19dc09bf}, log id: 2483f160 >2013-12-04 08:19:34,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 147db60e >2013-12-04 08:19:35,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 147db60e >2013-12-04 08:19:35,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5452125 >2013-12-04 08:19:35,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@191ef5fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83db6bf2}, log id: 5452125 >2013-12-04 08:19:40,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1117c75d >2013-12-04 08:19:41,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1117c75d >2013-12-04 08:19:41,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6d476b77 >2013-12-04 08:19:41,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d456e0b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0edbbf1}, log id: 6d476b77 >2013-12-04 08:19:46,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1874e7cd >2013-12-04 08:19:46,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1874e7cd >2013-12-04 08:19:46,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 59ce0274 >2013-12-04 08:19:47,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f8b1c96, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c32e68e5}, log id: 59ce0274 >2013-12-04 08:19:52,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6d90461b >2013-12-04 08:19:52,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6d90461b >2013-12-04 08:19:52,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4092e458 >2013-12-04 08:19:53,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cf0b46a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43813940}, log id: 4092e458 >2013-12-04 08:19:58,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: cc0f116 >2013-12-04 08:19:58,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: cc0f116 >2013-12-04 08:19:58,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19e2afa >2013-12-04 08:19:58,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@580fa078, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@135fdc02}, log id: 19e2afa >2013-12-04 08:20:03,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3aa1b061 >2013-12-04 08:20:04,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3aa1b061 >2013-12-04 08:20:04,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2f772060 >2013-12-04 08:20:04,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1387650e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@daf9e553}, log id: 2f772060 >2013-12-04 08:20:09,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e754e02 >2013-12-04 08:20:10,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e754e02 >2013-12-04 08:20:10,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45e6a351 >2013-12-04 08:20:10,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb5acabd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c380913}, log id: 45e6a351 >2013-12-04 08:20:15,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 324abbb5 >2013-12-04 08:20:15,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 324abbb5 >2013-12-04 08:20:15,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f4b08cb >2013-12-04 08:20:16,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e03edc5a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f36aacb0}, log id: 7f4b08cb >2013-12-04 08:20:21,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 746961af >2013-12-04 08:20:21,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 746961af >2013-12-04 08:20:21,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 47ab1186 >2013-12-04 08:20:21,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b73987c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8eefc362}, log id: 47ab1186 >2013-12-04 08:20:26,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 10fd7713 >2013-12-04 08:20:27,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 10fd7713 >2013-12-04 08:20:27,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3a7849b0 >2013-12-04 08:20:27,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74c6c5e5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebcbbdf6}, log id: 3a7849b0 >2013-12-04 08:20:29,144 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-04 08:20:29,144 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:20:29,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 656d7715 >2013-12-04 08:20:29,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 656d7715 >2013-12-04 08:20:32,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67fa8dbc >2013-12-04 08:20:33,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 67fa8dbc >2013-12-04 08:20:33,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4fe3fd2 >2013-12-04 08:20:33,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe210529, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80181ae8}, log id: 4fe3fd2 >2013-12-04 08:20:38,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2aa5f824 >2013-12-04 08:20:39,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2aa5f824 >2013-12-04 08:20:39,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 260477d9 >2013-12-04 08:20:39,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4c07223, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12d4a5a7}, log id: 260477d9 >2013-12-04 08:20:44,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7727235 >2013-12-04 08:20:44,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7727235 >2013-12-04 08:20:44,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 44bd925b >2013-12-04 08:20:45,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aac606be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38d6a4a9}, log id: 44bd925b >2013-12-04 08:20:50,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: c1766c4 >2013-12-04 08:20:50,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: c1766c4 >2013-12-04 08:20:50,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 9b959a9 >2013-12-04 08:20:50,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18ca4ed0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31d6bbf4}, log id: 9b959a9 >2013-12-04 08:20:55,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3083ae6f >2013-12-04 08:20:56,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3083ae6f >2013-12-04 08:20:56,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ab33adc >2013-12-04 08:20:56,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@729a1e06, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4630f5ff}, log id: ab33adc >2013-12-04 08:21:01,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ce9c8e4 >2013-12-04 08:21:02,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: ce9c8e4 >2013-12-04 08:21:02,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14323d99 >2013-12-04 08:21:02,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1afb2ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77702a3f}, log id: 14323d99 >2013-12-04 08:21:07,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 22088049 >2013-12-04 08:21:07,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 22088049 >2013-12-04 08:21:07,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 9532b56 >2013-12-04 08:21:08,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bbb307b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52687c90}, log id: 9532b56 >2013-12-04 08:21:13,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 338e029d >2013-12-04 08:21:13,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 338e029d >2013-12-04 08:21:13,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b5477c3 >2013-12-04 08:21:13,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@253ea528, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b529a6e5}, log id: b5477c3 >2013-12-04 08:21:18,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f0525f5 >2013-12-04 08:21:19,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f0525f5 >2013-12-04 08:21:19,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2874cc11 >2013-12-04 08:21:19,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ca71fd0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17837a41}, log id: 2874cc11 >2013-12-04 08:21:24,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5be106a6 >2013-12-04 08:21:25,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5be106a6 >2013-12-04 08:21:25,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7b9c856c >2013-12-04 08:21:25,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b60996c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccc21a47}, log id: 7b9c856c >2013-12-04 08:21:29,430 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) No up server in cluster >2013-12-04 08:21:29,430 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:21:29,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1c3e3857 >2013-12-04 08:21:29,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1c3e3857 >2013-12-04 08:21:30,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 433a4f90 >2013-12-04 08:21:30,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 433a4f90 >2013-12-04 08:21:30,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 67440379 >2013-12-04 08:21:31,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f2d588c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58b49079}, log id: 67440379 >2013-12-04 08:21:36,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73692e52 >2013-12-04 08:21:36,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 73692e52 >2013-12-04 08:21:36,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c62ea3a >2013-12-04 08:21:36,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18eac241, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19ed47a3}, log id: 2c62ea3a >2013-12-04 08:21:42,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 433b34ce >2013-12-04 08:21:42,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 433b34ce >2013-12-04 08:21:42,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26e2e6df >2013-12-04 08:21:42,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@560fb8c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc453f76}, log id: 26e2e6df >2013-12-04 08:21:47,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 454d3577 >2013-12-04 08:21:48,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 454d3577 >2013-12-04 08:21:48,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10324d0c >2013-12-04 08:21:48,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e439f3fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@376c6539}, log id: 10324d0c >2013-12-04 08:21:53,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 51fa54ac >2013-12-04 08:21:54,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 51fa54ac >2013-12-04 08:21:54,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5a6f5e45 >2013-12-04 08:21:54,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dec1524, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba736f17}, log id: 5a6f5e45 >2013-12-04 08:21:59,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3225fd43 >2013-12-04 08:21:59,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3225fd43 >2013-12-04 08:21:59,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6230299 >2013-12-04 08:22:00,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7e25e7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58cd51a4}, log id: 6230299 >2013-12-04 08:22:05,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1d3415c >2013-12-04 08:22:05,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1d3415c >2013-12-04 08:22:05,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1768257f >2013-12-04 08:22:05,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c5acc0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2694837a}, log id: 1768257f >2013-12-04 08:22:11,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c700ca5 >2013-12-04 08:22:11,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2c700ca5 >2013-12-04 08:22:11,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 15e66068 >2013-12-04 08:22:11,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2b5fee2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1ed339c}, log id: 15e66068 >2013-12-04 08:22:16,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1954ec6f >2013-12-04 08:22:17,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1954ec6f >2013-12-04 08:22:17,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 268cb2ec >2013-12-04 08:22:17,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a90663c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5855b10a}, log id: 268cb2ec >2013-12-04 08:22:22,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a37bba8 >2013-12-04 08:22:23,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4a37bba8 >2013-12-04 08:22:23,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1dd9ecd4 >2013-12-04 08:22:23,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1126606e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@106ec320}, log id: 1dd9ecd4 >2013-12-04 08:22:28,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: b337d23 >2013-12-04 08:22:29,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: b337d23 >2013-12-04 08:22:29,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6b98c90 >2013-12-04 08:22:29,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71b7d26b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64143637}, log id: 6b98c90 >2013-12-04 08:22:29,721 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) No up server in cluster >2013-12-04 08:22:29,721 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:22:29,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 9f1d39 >2013-12-04 08:22:30,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterTasksListVDSCommand, return: [], log id: 9f1d39 >2013-12-04 08:22:34,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43d06fb9 >2013-12-04 08:22:35,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 43d06fb9 >2013-12-04 08:22:35,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7fdb9992 >2013-12-04 08:22:35,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2e7181c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@258eba0d}, log id: 7fdb9992 >2013-12-04 08:22:40,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10a1a824 >2013-12-04 08:22:40,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 10a1a824 >2013-12-04 08:22:40,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 78763621 >2013-12-04 08:22:41,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68a55d5c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d08679d}, log id: 78763621 >2013-12-04 08:22:46,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50729917 >2013-12-04 08:22:46,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 50729917 >2013-12-04 08:22:46,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70c0bf07 >2013-12-04 08:22:46,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0273b34, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@969d4535}, log id: 70c0bf07 >2013-12-04 08:22:51,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7bdba11d >2013-12-04 08:22:52,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7bdba11d >2013-12-04 08:22:52,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e037cea >2013-12-04 08:22:52,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e56dace, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b496fbf}, log id: 7e037cea >2013-12-04 08:22:57,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39248ab1 >2013-12-04 08:22:58,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 39248ab1 >2013-12-04 08:22:58,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 44196180 >2013-12-04 08:22:58,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec952c8a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6be646f7}, log id: 44196180 >2013-12-04 08:23:03,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f9d3d5c >2013-12-04 08:23:04,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5f9d3d5c >2013-12-04 08:23:04,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 155e1a8 >2013-12-04 08:23:04,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@199f468b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cf02057}, log id: 155e1a8 >2013-12-04 08:23:09,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 140ca813 >2013-12-04 08:23:10,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 140ca813 >2013-12-04 08:23:10,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4c3c1c33 >2013-12-04 08:23:10,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16d08784, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7612478d}, log id: 4c3c1c33 >2013-12-04 08:23:15,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: b7ad9d6 >2013-12-04 08:23:15,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: b7ad9d6 >2013-12-04 08:23:15,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 622ea0ab >2013-12-04 08:23:16,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31b8963, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19f03bbc}, log id: 622ea0ab >2013-12-04 08:23:21,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70b4d163 >2013-12-04 08:23:21,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 70b4d163 >2013-12-04 08:23:21,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f7b8f86 >2013-12-04 08:23:21,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c2d7e4e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c189d10f}, log id: 6f7b8f86 >2013-12-04 08:23:26,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1dfac3cb >2013-12-04 08:23:27,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1dfac3cb >2013-12-04 08:23:27,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 16d4776 >2013-12-04 08:23:27,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84a8c655, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ec7b127}, log id: 16d4776 >2013-12-04 08:23:30,029 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-04 08:23:30,029 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:23:30,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b56a686 >2013-12-04 08:23:30,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: b56a686 >2013-12-04 08:23:32,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17fe3859 >2013-12-04 08:23:33,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 17fe3859 >2013-12-04 08:23:33,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 702539e3 >2013-12-04 08:23:33,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@489b162c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a705f99}, log id: 702539e3 >2013-12-04 08:23:38,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a3682c9 >2013-12-04 08:23:39,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a3682c9 >2013-12-04 08:23:39,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 33326d38 >2013-12-04 08:23:39,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16647d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8d4826c}, log id: 33326d38 >2013-12-04 08:23:44,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54dce13f >2013-12-04 08:23:44,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 54dce13f >2013-12-04 08:23:44,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 50aaf026 >2013-12-04 08:23:45,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2edb8aa6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@662eb01}, log id: 50aaf026 >2013-12-04 08:23:50,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 351a3a0c >2013-12-04 08:23:50,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 351a3a0c >2013-12-04 08:23:50,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7112380e >2013-12-04 08:23:50,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7b0b65d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eddf861f}, log id: 7112380e >2013-12-04 08:23:55,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1890f71f >2013-12-04 08:23:56,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1890f71f >2013-12-04 08:23:56,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ba0f098 >2013-12-04 08:23:56,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87f50596, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7b97d01}, log id: 4ba0f098 >2013-12-04 08:24:01,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 329000e5 >2013-12-04 08:24:02,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 329000e5 >2013-12-04 08:24:02,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 159a6dba >2013-12-04 08:24:02,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67bb63af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af544eb6}, log id: 159a6dba >2013-12-04 08:24:07,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6bc181c2 >2013-12-04 08:24:07,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bc181c2 >2013-12-04 08:24:07,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: e68d964 >2013-12-04 08:24:08,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd515246, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91d806dd}, log id: e68d964 >2013-12-04 08:24:13,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b561c5d >2013-12-04 08:24:13,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5b561c5d >2013-12-04 08:24:13,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e54c6ba >2013-12-04 08:24:14,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcf0cd13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab3de715}, log id: 2e54c6ba >2013-12-04 08:24:19,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78f1104b >2013-12-04 08:24:19,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 78f1104b >2013-12-04 08:24:19,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 66ca96e >2013-12-04 08:24:19,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbd0a580, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6d1d74d}, log id: 66ca96e >2013-12-04 08:24:24,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79c88280 >2013-12-04 08:24:24,890 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-87) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:24:24,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@e253a5d, log id: 79c88280 >2013-12-04 08:24:24,906 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-89) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:24:24,911 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-87) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:24:24,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e1ab6ec >2013-12-04 08:24:24,975 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-87) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:24:25,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@35dd5534, log id: 2e1ab6ec >2013-12-04 08:24:25,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5604e48c >2013-12-04 08:24:25,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5604e48c >2013-12-04 08:24:25,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 25ef0395 >2013-12-04 08:24:25,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b25533b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2132d94d}, log id: 25ef0395 >2013-12-04 08:24:30,340 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) [7973d44b] No up server in cluster >2013-12-04 08:24:30,340 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) [7973d44b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:24:30,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 614e08ae >2013-12-04 08:24:30,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterTasksListVDSCommand, return: [], log id: 614e08ae >2013-12-04 08:24:31,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6dd91c31 >2013-12-04 08:24:31,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6dd91c31 >2013-12-04 08:24:31,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48a344fb >2013-12-04 08:24:31,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3fae172, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c4b067}, log id: 48a344fb >2013-12-04 08:24:36,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 43a0ca77 >2013-12-04 08:24:37,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 43a0ca77 >2013-12-04 08:24:37,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 43ccd4a4 >2013-12-04 08:24:37,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76daa677, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e810a78e}, log id: 43ccd4a4 >2013-12-04 08:24:42,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 510ce7ec >2013-12-04 08:24:43,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 510ce7ec >2013-12-04 08:24:43,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6811ffc1 >2013-12-04 08:24:43,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2be38124, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7a5af0f}, log id: 6811ffc1 >2013-12-04 08:24:48,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 71bab312 >2013-12-04 08:24:48,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 71bab312 >2013-12-04 08:24:48,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 278506e >2013-12-04 08:24:49,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78961e8e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ac2ca2e}, log id: 278506e >2013-12-04 08:24:54,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ee6c851 >2013-12-04 08:24:54,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: ee6c851 >2013-12-04 08:24:54,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5e095d1f >2013-12-04 08:24:54,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@645aee61, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2528582}, log id: 5e095d1f >2013-12-04 08:24:59,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1adaf8e >2013-12-04 08:25:00,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1adaf8e >2013-12-04 08:25:00,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 371d4fbe >2013-12-04 08:25:00,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8ef86c4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23797e4c}, log id: 371d4fbe >2013-12-04 08:25:05,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3fdc8c >2013-12-04 08:25:06,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3fdc8c >2013-12-04 08:25:06,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18e2d8e5 >2013-12-04 08:25:06,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc236d70, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2b3f7ff}, log id: 18e2d8e5 >2013-12-04 08:25:11,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 466d4ed3 >2013-12-04 08:25:12,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 466d4ed3 >2013-12-04 08:25:12,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1395ac1c >2013-12-04 08:25:12,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da1d7a09, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd15f078}, log id: 1395ac1c >2013-12-04 08:25:17,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 696d74f2 >2013-12-04 08:25:17,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 696d74f2 >2013-12-04 08:25:17,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 438b6a8a >2013-12-04 08:25:18,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23b978db, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfae9c53}, log id: 438b6a8a >2013-12-04 08:25:23,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57912bda >2013-12-04 08:25:23,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 57912bda >2013-12-04 08:25:23,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d823f91 >2013-12-04 08:25:23,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@618f8844, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbb2b71e}, log id: d823f91 >2013-12-04 08:25:28,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 82818b3 >2013-12-04 08:25:29,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 82818b3 >2013-12-04 08:25:29,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7fcb7fcb >2013-12-04 08:25:29,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6239cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d0974de}, log id: 7fcb7fcb >2013-12-04 08:25:30,638 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-04 08:25:30,638 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:25:30,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3b2e6d9f >2013-12-04 08:25:30,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3b2e6d9f >2013-12-04 08:25:34,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 56daf711 >2013-12-04 08:25:35,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 56daf711 >2013-12-04 08:25:35,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 698fd0d8 >2013-12-04 08:25:35,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77874bb4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac2429f8}, log id: 698fd0d8 >2013-12-04 08:25:40,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 21cf1e05 >2013-12-04 08:25:40,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 21cf1e05 >2013-12-04 08:25:40,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 73f3a38b >2013-12-04 08:25:41,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a839d13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e8c0310}, log id: 73f3a38b >2013-12-04 08:25:46,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 700a435c >2013-12-04 08:25:46,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 700a435c >2013-12-04 08:25:46,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7eff07b >2013-12-04 08:25:47,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf8cfd52, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b175825}, log id: 7eff07b >2013-12-04 08:25:52,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63707c2f >2013-12-04 08:25:52,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 63707c2f >2013-12-04 08:25:52,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 74361159 >2013-12-04 08:25:52,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ec6d400, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1802bb13}, log id: 74361159 >2013-12-04 08:25:57,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 728a7816 >2013-12-04 08:25:58,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 728a7816 >2013-12-04 08:25:58,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47f9fd03 >2013-12-04 08:25:58,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b15f9ded, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62caafbb}, log id: 47f9fd03 >2013-12-04 08:26:03,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1ff9eb58 >2013-12-04 08:26:04,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1ff9eb58 >2013-12-04 08:26:04,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a10b66e >2013-12-04 08:26:04,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@362a00fa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90ebbb67}, log id: 1a10b66e >2013-12-04 08:26:09,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c919fc6 >2013-12-04 08:26:09,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2c919fc6 >2013-12-04 08:26:09,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 150200b6 >2013-12-04 08:26:10,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98e858b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63f1ad6d}, log id: 150200b6 >2013-12-04 08:26:15,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2a55bae8 >2013-12-04 08:26:15,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2a55bae8 >2013-12-04 08:26:15,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6afb2f3a >2013-12-04 08:26:16,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdcf5ec6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7a1f070}, log id: 6afb2f3a >2013-12-04 08:26:21,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39249c16 >2013-12-04 08:26:21,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 39249c16 >2013-12-04 08:26:21,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3154e778 >2013-12-04 08:26:21,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a155e4f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c12bafb}, log id: 3154e778 >2013-12-04 08:26:26,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 75d72efa >2013-12-04 08:26:27,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 75d72efa >2013-12-04 08:26:27,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6371923c >2013-12-04 08:26:27,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edacfdc8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@861210dc}, log id: 6371923c >2013-12-04 08:26:30,970 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) No up server in cluster >2013-12-04 08:26:30,970 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:26:30,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 48f0ae8a >2013-12-04 08:26:31,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterTasksListVDSCommand, return: [], log id: 48f0ae8a >2013-12-04 08:26:32,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1278c060 >2013-12-04 08:26:33,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1278c060 >2013-12-04 08:26:33,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 443be42c >2013-12-04 08:26:33,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e1480a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@664cb5bc}, log id: 443be42c >2013-12-04 08:26:38,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5d9b01d1 >2013-12-04 08:26:38,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d9b01d1 >2013-12-04 08:26:38,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 368229c0 >2013-12-04 08:26:39,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9993dd95, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a11ceae9}, log id: 368229c0 >2013-12-04 08:26:44,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6cc7c250 >2013-12-04 08:26:44,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cc7c250 >2013-12-04 08:26:44,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 31b846ce >2013-12-04 08:26:44,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0d324e1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cf42552}, log id: 31b846ce >2013-12-04 08:26:49,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 37efd97e >2013-12-04 08:26:50,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 37efd97e >2013-12-04 08:26:50,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b45a6d >2013-12-04 08:26:50,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@169a9f44, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70cd78a7}, log id: 3b45a6d >2013-12-04 08:26:55,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: a3cddc3 >2013-12-04 08:26:56,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: a3cddc3 >2013-12-04 08:26:56,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 23869ae0 >2013-12-04 08:26:56,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b127e6a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcddf8cd}, log id: 23869ae0 >2013-12-04 08:27:01,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 445275b7 >2013-12-04 08:27:01,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 445275b7 >2013-12-04 08:27:01,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21e0e860 >2013-12-04 08:27:02,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df5368f3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2733fd48}, log id: 21e0e860 >2013-12-04 08:27:07,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f15270 >2013-12-04 08:27:07,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7f15270 >2013-12-04 08:27:07,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2658e62b >2013-12-04 08:27:08,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23c401bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa25ef5a}, log id: 2658e62b >2013-12-04 08:27:13,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2486e73f >2013-12-04 08:27:13,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2486e73f >2013-12-04 08:27:13,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6637a806 >2013-12-04 08:27:13,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@685da229, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86afd798}, log id: 6637a806 >2013-12-04 08:27:18,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2bb849f7 >2013-12-04 08:27:19,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2bb849f7 >2013-12-04 08:27:19,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1e3656d5 >2013-12-04 08:27:19,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ed4e819, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20488e35}, log id: 1e3656d5 >2013-12-04 08:27:24,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a99a50b >2013-12-04 08:27:25,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1a99a50b >2013-12-04 08:27:25,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 645f90ee >2013-12-04 08:27:25,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4818cc76, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b84fae47}, log id: 645f90ee >2013-12-04 08:27:30,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 604ce168 >2013-12-04 08:27:30,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 604ce168 >2013-12-04 08:27:30,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 53fa2c53 >2013-12-04 08:27:31,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d325f0ca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@851429fb}, log id: 53fa2c53 >2013-12-04 08:27:31,282 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) No up server in cluster >2013-12-04 08:27:31,282 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:27:31,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 35c45c24 >2013-12-04 08:27:31,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, return: [], log id: 35c45c24 >2013-12-04 08:27:36,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 590893d7 >2013-12-04 08:27:36,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 590893d7 >2013-12-04 08:27:36,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34eb430 >2013-12-04 08:27:37,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38c110f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72866561}, log id: 34eb430 >2013-12-04 08:27:42,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ad54f72 >2013-12-04 08:27:42,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1ad54f72 >2013-12-04 08:27:42,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c4cbb7d >2013-12-04 08:27:42,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b7d40bd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9e19631}, log id: 5c4cbb7d >2013-12-04 08:27:47,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 689ac6ab >2013-12-04 08:27:48,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 689ac6ab >2013-12-04 08:27:48,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 48e5daea >2013-12-04 08:27:48,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75b29771, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebe9dcfa}, log id: 48e5daea >2013-12-04 08:27:53,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: aa12921 >2013-12-04 08:27:54,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: aa12921 >2013-12-04 08:27:54,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18ad591f >2013-12-04 08:27:54,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb0b53ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ad82d09}, log id: 18ad591f >2013-12-04 08:27:59,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4471ccf6 >2013-12-04 08:28:00,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4471ccf6 >2013-12-04 08:28:00,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 242fe91f >2013-12-04 08:28:00,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f07ae67, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cef2b49}, log id: 242fe91f >2013-12-04 08:28:05,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7ee55084 >2013-12-04 08:28:05,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7ee55084 >2013-12-04 08:28:05,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 669728d5 >2013-12-04 08:28:06,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c778ac8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86a6d87a}, log id: 669728d5 >2013-12-04 08:28:11,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10f54d51 >2013-12-04 08:28:11,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 10f54d51 >2013-12-04 08:28:11,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 22256a20 >2013-12-04 08:28:11,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a720c4d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90bdf9f}, log id: 22256a20 >2013-12-04 08:28:16,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ed65465 >2013-12-04 08:28:17,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7ed65465 >2013-12-04 08:28:17,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3ce4e1d9 >2013-12-04 08:28:17,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@843f4658, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@429208f1}, log id: 3ce4e1d9 >2013-12-04 08:28:22,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 73df8cf2 >2013-12-04 08:28:23,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 73df8cf2 >2013-12-04 08:28:23,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 128c3835 >2013-12-04 08:28:23,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@887a97de, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@272df332}, log id: 128c3835 >2013-12-04 08:28:28,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39500143 >2013-12-04 08:28:29,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 39500143 >2013-12-04 08:28:29,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a7236e >2013-12-04 08:28:29,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef0ed4b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5212ab4a}, log id: a7236e >2013-12-04 08:28:31,589 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) No up server in cluster >2013-12-04 08:28:31,590 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:28:31,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7af5e10a >2013-12-04 08:28:31,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7af5e10a >2013-12-04 08:28:34,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 414e2745 >2013-12-04 08:28:34,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 414e2745 >2013-12-04 08:28:34,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7020450e >2013-12-04 08:28:35,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0f564d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7695495a}, log id: 7020450e >2013-12-04 08:28:40,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a338b59 >2013-12-04 08:28:40,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a338b59 >2013-12-04 08:28:40,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1c544476 >2013-12-04 08:28:40,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8743a669, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2599c6dc}, log id: 1c544476 >2013-12-04 08:28:45,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66236e67 >2013-12-04 08:28:46,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 66236e67 >2013-12-04 08:28:46,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15a8af58 >2013-12-04 08:28:46,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@230e87de, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7555848}, log id: 15a8af58 >2013-12-04 08:28:51,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: f25e233 >2013-12-04 08:28:52,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: f25e233 >2013-12-04 08:28:52,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 32f75364 >2013-12-04 08:28:52,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29b288fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d69b4ea}, log id: 32f75364 >2013-12-04 08:28:57,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4337cc7c >2013-12-04 08:28:58,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4337cc7c >2013-12-04 08:28:58,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3f35bd31 >2013-12-04 08:28:58,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58cc02de, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce0b1bdb}, log id: 3f35bd31 >2013-12-04 08:29:03,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 259abf03 >2013-12-04 08:29:03,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 259abf03 >2013-12-04 08:29:03,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: d4e8602 >2013-12-04 08:29:04,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95f5c229, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23ffd8a4}, log id: d4e8602 >2013-12-04 08:29:09,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18df4b94 >2013-12-04 08:29:09,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 18df4b94 >2013-12-04 08:29:09,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 74f5d88a >2013-12-04 08:29:09,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5ab7d12, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ad48046}, log id: 74f5d88a >2013-12-04 08:29:14,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4352c08a >2013-12-04 08:29:15,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4352c08a >2013-12-04 08:29:15,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 758d1e45 >2013-12-04 08:29:15,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba2ab76d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33cad48d}, log id: 758d1e45 >2013-12-04 08:29:20,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 78611762 >2013-12-04 08:29:21,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 78611762 >2013-12-04 08:29:21,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a88cb00 >2013-12-04 08:29:21,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d26e8e7a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1cbd7a6}, log id: 7a88cb00 >2013-12-04 08:29:25,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7718f6fc >2013-12-04 08:29:25,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1c464a7c, log id: 7718f6fc >2013-12-04 08:29:25,518 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-53) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:29:25,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4ac42164 >2013-12-04 08:29:25,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@71bf8d8e, log id: 4ac42164 >2013-12-04 08:29:26,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74806662 >2013-12-04 08:29:26,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 74806662 >2013-12-04 08:29:26,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fd55b7e >2013-12-04 08:29:27,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc6881fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25bafaaa}, log id: 2fd55b7e >2013-12-04 08:29:31,898 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [6e7f0088] No up server in cluster >2013-12-04 08:29:31,898 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [6e7f0088] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:29:31,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 15d81d21 >2013-12-04 08:29:32,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterTasksListVDSCommand, return: [], log id: 15d81d21 >2013-12-04 08:29:32,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73af14a5 >2013-12-04 08:29:32,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 73af14a5 >2013-12-04 08:29:32,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c7fbc77 >2013-12-04 08:29:33,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8faef11, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@934c8478}, log id: 2c7fbc77 >2013-12-04 08:29:38,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 50219dc3 >2013-12-04 08:29:38,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 50219dc3 >2013-12-04 08:29:38,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ca54af4 >2013-12-04 08:29:38,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7093ee7d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8c884c7}, log id: 1ca54af4 >2013-12-04 08:29:43,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32707d8e >2013-12-04 08:29:44,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 32707d8e >2013-12-04 08:29:44,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 249a1b85 >2013-12-04 08:29:44,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85c4ce7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b590cd9e}, log id: 249a1b85 >2013-12-04 08:29:49,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 492000f4 >2013-12-04 08:29:50,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 492000f4 >2013-12-04 08:29:50,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 444a552d >2013-12-04 08:29:50,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14e96aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6cfa534}, log id: 444a552d >2013-12-04 08:29:55,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1e33c281 >2013-12-04 08:29:55,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1e33c281 >2013-12-04 08:29:55,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15b0d1e6 >2013-12-04 08:29:56,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5204fa23, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7714c88}, log id: 15b0d1e6 >2013-12-04 08:30:01,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10ca509b >2013-12-04 08:30:01,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 10ca509b >2013-12-04 08:30:01,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: d87739 >2013-12-04 08:30:01,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f6b21cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d473afb}, log id: d87739 >2013-12-04 08:30:07,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f55f90 >2013-12-04 08:30:07,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f55f90 >2013-12-04 08:30:07,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c7fe365 >2013-12-04 08:30:07,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa85cb29, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adb61e4d}, log id: 1c7fe365 >2013-12-04 08:30:12,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: b0fd71a >2013-12-04 08:30:13,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: b0fd71a >2013-12-04 08:30:13,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7275e52d >2013-12-04 08:30:13,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@471b058d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fcdbfd5}, log id: 7275e52d >2013-12-04 08:30:18,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 215bb604 >2013-12-04 08:30:19,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 215bb604 >2013-12-04 08:30:19,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 52828d86 >2013-12-04 08:30:19,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28b49952, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5a4d85d}, log id: 52828d86 >2013-12-04 08:30:24,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3f3521d8 >2013-12-04 08:30:24,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f3521d8 >2013-12-04 08:30:24,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 107b1760 >2013-12-04 08:30:25,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8fc4693, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43d26ae2}, log id: 107b1760 >2013-12-04 08:30:30,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b57bdd2 >2013-12-04 08:30:30,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1b57bdd2 >2013-12-04 08:30:30,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50cfaf25 >2013-12-04 08:30:30,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afaac6c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6320cd6}, log id: 50cfaf25 >2013-12-04 08:30:32,181 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-7) No up server in cluster >2013-12-04 08:30:32,181 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-7) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:30:32,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2070c2d6 >2013-12-04 08:30:32,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2070c2d6 >2013-12-04 08:30:36,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: ae058b3 >2013-12-04 08:30:36,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: ae058b3 >2013-12-04 08:30:36,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 466c8976 >2013-12-04 08:30:36,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7433078, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@323ab568}, log id: 466c8976 >2013-12-04 08:30:41,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 533b2d70 >2013-12-04 08:30:42,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 533b2d70 >2013-12-04 08:30:42,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1549fe69 >2013-12-04 08:30:42,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f212a2ff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95445147}, log id: 1549fe69 >2013-12-04 08:30:47,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 40cb1016 >2013-12-04 08:30:48,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 40cb1016 >2013-12-04 08:30:48,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 163fbd9c >2013-12-04 08:30:48,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8599c93d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c5fda33}, log id: 163fbd9c >2013-12-04 08:30:53,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 21d836b2 >2013-12-04 08:30:53,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 21d836b2 >2013-12-04 08:30:53,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7ab6af68 >2013-12-04 08:30:54,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5889113, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b60f2bc0}, log id: 7ab6af68 >2013-12-04 08:30:59,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 755a53da >2013-12-04 08:30:59,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 755a53da >2013-12-04 08:30:59,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22185cf4 >2013-12-04 08:30:59,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4cf51f7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0d01542}, log id: 22185cf4 >2013-12-04 08:31:05,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7493caab >2013-12-04 08:31:05,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7493caab >2013-12-04 08:31:05,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 487e71b6 >2013-12-04 08:31:05,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@915a41b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d43efd8}, log id: 487e71b6 >2013-12-04 08:31:10,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 424915bf >2013-12-04 08:31:11,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 424915bf >2013-12-04 08:31:11,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2fcda51a >2013-12-04 08:31:11,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@700f5350, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b0bb1d9}, log id: 2fcda51a >2013-12-04 08:31:16,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2386e857 >2013-12-04 08:31:17,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2386e857 >2013-12-04 08:31:17,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b12969b >2013-12-04 08:31:17,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1bc9ea7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f428186f}, log id: 3b12969b >2013-12-04 08:31:22,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57a901aa >2013-12-04 08:31:22,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 57a901aa >2013-12-04 08:31:22,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 307344cd >2013-12-04 08:31:23,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f118d25c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a27c7a0}, log id: 307344cd >2013-12-04 08:31:28,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2a2abb5e >2013-12-04 08:31:28,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2a2abb5e >2013-12-04 08:31:28,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 151d1e30 >2013-12-04 08:31:28,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70b7458e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@305f3457}, log id: 151d1e30 >2013-12-04 08:31:32,480 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-04 08:31:32,481 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:31:32,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34e03bf6 >2013-12-04 08:31:32,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 34e03bf6 >2013-12-04 08:31:33,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 16038fda >2013-12-04 08:31:34,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 16038fda >2013-12-04 08:31:34,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 13afc463 >2013-12-04 08:31:34,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23aa18de, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3872c377}, log id: 13afc463 >2013-12-04 08:31:39,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 8fd9383 >2013-12-04 08:31:40,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 8fd9383 >2013-12-04 08:31:40,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78611f57 >2013-12-04 08:31:40,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a88595e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0b9e8bc}, log id: 78611f57 >2013-12-04 08:31:45,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c8d5273 >2013-12-04 08:31:45,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5c8d5273 >2013-12-04 08:31:45,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d63c582 >2013-12-04 08:31:46,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e638c8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7d704f6}, log id: 6d63c582 >2013-12-04 08:31:51,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4a103578 >2013-12-04 08:31:51,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4a103578 >2013-12-04 08:31:51,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4a6a727f >2013-12-04 08:31:52,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f80bfc46, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92d0b153}, log id: 4a6a727f >2013-12-04 08:31:57,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 41768752 >2013-12-04 08:31:57,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 41768752 >2013-12-04 08:31:57,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: a6f8a39 >2013-12-04 08:31:57,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3277676, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73c7a71d}, log id: a6f8a39 >2013-12-04 08:32:02,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76454251 >2013-12-04 08:32:03,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 76454251 >2013-12-04 08:32:03,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 304f2663 >2013-12-04 08:32:03,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68c88eba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a78822b}, log id: 304f2663 >2013-12-04 08:32:08,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a6f2a96 >2013-12-04 08:32:09,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a6f2a96 >2013-12-04 08:32:09,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1505db22 >2013-12-04 08:32:09,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c30177d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@703e170}, log id: 1505db22 >2013-12-04 08:32:14,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4493ae81 >2013-12-04 08:32:14,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4493ae81 >2013-12-04 08:32:14,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3c412597 >2013-12-04 08:32:15,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b12cbb94, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cef5fa1d}, log id: 3c412597 >2013-12-04 08:32:20,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 258873b8 >2013-12-04 08:32:20,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 258873b8 >2013-12-04 08:32:20,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70099769 >2013-12-04 08:32:20,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d84f0b22, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81172340}, log id: 70099769 >2013-12-04 08:32:25,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4262a601 >2013-12-04 08:32:26,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4262a601 >2013-12-04 08:32:26,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 604915bc >2013-12-04 08:32:26,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff670047, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a8e3c01}, log id: 604915bc >2013-12-04 08:32:31,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14ac4a68 >2013-12-04 08:32:32,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 14ac4a68 >2013-12-04 08:32:32,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e0ff0e3 >2013-12-04 08:32:32,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea02af3f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f307050}, log id: 2e0ff0e3 >2013-12-04 08:32:32,767 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-04 08:32:32,767 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:32:32,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 27ed1e14 >2013-12-04 08:32:33,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: 27ed1e14 >2013-12-04 08:32:37,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4dc68e37 >2013-12-04 08:32:38,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4dc68e37 >2013-12-04 08:32:38,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 436936c3 >2013-12-04 08:32:38,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cee82b66, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bdaa843}, log id: 436936c3 >2013-12-04 08:32:43,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 66a3df17 >2013-12-04 08:32:43,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 66a3df17 >2013-12-04 08:32:43,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 518a94c3 >2013-12-04 08:32:44,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d17a9f80, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15198b64}, log id: 518a94c3 >2013-12-04 08:32:49,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2db44750 >2013-12-04 08:32:49,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2db44750 >2013-12-04 08:32:49,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: e3fdaaf >2013-12-04 08:32:49,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e348b81c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b874315}, log id: e3fdaaf >2013-12-04 08:32:54,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2f8857c4 >2013-12-04 08:32:55,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f8857c4 >2013-12-04 08:32:55,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 9cd340e >2013-12-04 08:32:55,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12cdd4ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a1b4a1b}, log id: 9cd340e >2013-12-04 08:33:00,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ca965de >2013-12-04 08:33:01,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4ca965de >2013-12-04 08:33:01,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5bab099b >2013-12-04 08:33:01,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49ca003c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d272838}, log id: 5bab099b >2013-12-04 08:33:06,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b1312af >2013-12-04 08:33:07,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2b1312af >2013-12-04 08:33:07,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5469f461 >2013-12-04 08:33:07,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fee1f3e3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e7d70d3}, log id: 5469f461 >2013-12-04 08:33:12,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2ad01a48 >2013-12-04 08:33:12,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ad01a48 >2013-12-04 08:33:12,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: d8de3d2 >2013-12-04 08:33:13,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14bbb7c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61de6163}, log id: d8de3d2 >2013-12-04 08:33:18,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24d80b62 >2013-12-04 08:33:18,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 24d80b62 >2013-12-04 08:33:18,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 442c54b1 >2013-12-04 08:33:19,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce9799f0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f109d40b}, log id: 442c54b1 >2013-12-04 08:33:24,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57e6312 >2013-12-04 08:33:24,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 57e6312 >2013-12-04 08:33:24,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 42484321 >2013-12-04 08:33:24,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcae955f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9abc66b8}, log id: 42484321 >2013-12-04 08:33:29,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b5f0d >2013-12-04 08:33:30,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b5f0d >2013-12-04 08:33:30,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 50537bab >2013-12-04 08:33:30,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee622d29, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91e22856}, log id: 50537bab >2013-12-04 08:33:33,053 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) [1f2a7840] No up server in cluster >2013-12-04 08:33:33,053 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) [1f2a7840] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:33:33,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1379547b >2013-12-04 08:33:33,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1379547b >2013-12-04 08:33:35,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77fafdba >2013-12-04 08:33:36,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 77fafdba >2013-12-04 08:33:36,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6dc18e1e >2013-12-04 08:33:36,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b16cd8d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7b0f14e}, log id: 6dc18e1e >2013-12-04 08:33:41,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10933499 >2013-12-04 08:33:42,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 10933499 >2013-12-04 08:33:42,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18e65c5a >2013-12-04 08:33:42,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45297595, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cfd82ef}, log id: 18e65c5a >2013-12-04 08:33:47,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 55fd16ea >2013-12-04 08:33:47,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 55fd16ea >2013-12-04 08:33:47,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6e1fa63e >2013-12-04 08:33:48,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c011757e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c88d329}, log id: 6e1fa63e >2013-12-04 08:33:53,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6cf4cb88 >2013-12-04 08:33:53,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6cf4cb88 >2013-12-04 08:33:53,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 62dac40 >2013-12-04 08:33:54,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff5af9be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff238196}, log id: 62dac40 >2013-12-04 08:33:59,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d0320a >2013-12-04 08:33:59,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3d0320a >2013-12-04 08:33:59,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6077e52e >2013-12-04 08:33:59,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56e9fa16, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6af2301b}, log id: 6077e52e >2013-12-04 08:34:04,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4fc4f095 >2013-12-04 08:34:05,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4fc4f095 >2013-12-04 08:34:05,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39d44aae >2013-12-04 08:34:05,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40852f7d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0b81836}, log id: 39d44aae >2013-12-04 08:34:10,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35777570 >2013-12-04 08:34:11,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 35777570 >2013-12-04 08:34:11,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3543dd0a >2013-12-04 08:34:11,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba9f2609, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ad23775}, log id: 3543dd0a >2013-12-04 08:34:16,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2060810b >2013-12-04 08:34:17,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2060810b >2013-12-04 08:34:17,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 875bb35 >2013-12-04 08:34:17,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d95d2f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a6fdab4}, log id: 875bb35 >2013-12-04 08:34:22,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 52b675dc >2013-12-04 08:34:22,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 52b675dc >2013-12-04 08:34:22,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 513475a4 >2013-12-04 08:34:23,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@705ad643, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1b1f4ba}, log id: 513475a4 >2013-12-04 08:34:25,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b400a5c >2013-12-04 08:34:26,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7f50258d, log id: b400a5c >2013-12-04 08:34:26,118 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-44) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:34:26,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 66d18d47 >2013-12-04 08:34:26,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7a136f8, log id: 66d18d47 >2013-12-04 08:34:28,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b16ca91 >2013-12-04 08:34:28,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4b16ca91 >2013-12-04 08:34:28,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6df4da6b >2013-12-04 08:34:28,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65dedf97, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43fcf7ce}, log id: 6df4da6b >2013-12-04 08:34:33,358 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-04 08:34:33,358 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:34:33,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4cf8a6ff >2013-12-04 08:34:33,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4cf8a6ff >2013-12-04 08:34:33,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 130eeaa1 >2013-12-04 08:34:34,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 130eeaa1 >2013-12-04 08:34:34,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7c9e66ae >2013-12-04 08:34:34,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89b3cb86, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@139b75e8}, log id: 7c9e66ae >2013-12-04 08:34:39,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6abd61cc >2013-12-04 08:34:40,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6abd61cc >2013-12-04 08:34:40,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: e6e1ff7 >2013-12-04 08:34:40,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d66a435, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ac3e31a}, log id: e6e1ff7 >2013-12-04 08:34:45,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 540e0ee8 >2013-12-04 08:34:46,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 540e0ee8 >2013-12-04 08:34:46,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 713ed3b6 >2013-12-04 08:34:46,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88d41859, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b6ea110}, log id: 713ed3b6 >2013-12-04 08:34:51,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78d32c91 >2013-12-04 08:34:51,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 78d32c91 >2013-12-04 08:34:51,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3964ba44 >2013-12-04 08:34:52,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3ed49b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddc17c37}, log id: 3964ba44 >2013-12-04 08:34:57,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e5bbaf8 >2013-12-04 08:34:57,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1e5bbaf8 >2013-12-04 08:34:57,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16018c37 >2013-12-04 08:34:57,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52788449, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb33fda5}, log id: 16018c37 >2013-12-04 08:35:02,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2dda07c9 >2013-12-04 08:35:03,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2dda07c9 >2013-12-04 08:35:03,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 14406cdc >2013-12-04 08:35:03,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e6b1080, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81650b7f}, log id: 14406cdc >2013-12-04 08:35:08,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2890c566 >2013-12-04 08:35:09,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2890c566 >2013-12-04 08:35:09,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e9f2dbd >2013-12-04 08:35:09,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@583fc636, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8497c3d}, log id: 3e9f2dbd >2013-12-04 08:35:14,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7852d244 >2013-12-04 08:35:15,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7852d244 >2013-12-04 08:35:15,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32a35385 >2013-12-04 08:35:15,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bef2a5b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8842d92}, log id: 32a35385 >2013-12-04 08:35:20,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1ea69dd2 >2013-12-04 08:35:20,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ea69dd2 >2013-12-04 08:35:20,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1feaece4 >2013-12-04 08:35:21,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@953016b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d46e25a6}, log id: 1feaece4 >2013-12-04 08:35:26,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a4df5e2 >2013-12-04 08:35:26,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5a4df5e2 >2013-12-04 08:35:26,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f106569 >2013-12-04 08:35:26,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a30bab8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94281d96}, log id: 5f106569 >2013-12-04 08:35:32,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6cd49ef7 >2013-12-04 08:35:32,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6cd49ef7 >2013-12-04 08:35:32,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4e0454af >2013-12-04 08:35:32,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6c0ab36, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdfe0dcb}, log id: 4e0454af >2013-12-04 08:35:33,683 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-04 08:35:33,683 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:35:33,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29f13e7 >2013-12-04 08:35:34,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 29f13e7 >2013-12-04 08:35:37,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 667799d6 >2013-12-04 08:35:38,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 667799d6 >2013-12-04 08:35:38,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c7b0528 >2013-12-04 08:35:38,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92d0357e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@488fb7e3}, log id: 3c7b0528 >2013-12-04 08:35:43,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4cf25728 >2013-12-04 08:35:44,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4cf25728 >2013-12-04 08:35:44,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f2fb816 >2013-12-04 08:35:44,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5f2e3e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aff61d81}, log id: 6f2fb816 >2013-12-04 08:35:49,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a6a8705 >2013-12-04 08:35:49,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4a6a8705 >2013-12-04 08:35:49,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5fb62b0a >2013-12-04 08:35:50,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce6461ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b185a9b}, log id: 5fb62b0a >2013-12-04 08:35:55,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c371e1b >2013-12-04 08:35:55,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5c371e1b >2013-12-04 08:35:55,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c039e73 >2013-12-04 08:35:56,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7cec22f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35131c3e}, log id: c039e73 >2013-12-04 08:36:01,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 748105c7 >2013-12-04 08:36:01,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 748105c7 >2013-12-04 08:36:01,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4f69df88 >2013-12-04 08:36:01,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82e29c9b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5b1ee9e}, log id: 4f69df88 >2013-12-04 08:36:06,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2f2fad75 >2013-12-04 08:36:07,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2f2fad75 >2013-12-04 08:36:07,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2a5850f5 >2013-12-04 08:36:07,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4b75fbb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcb3cddb}, log id: 2a5850f5 >2013-12-04 08:36:12,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 337c672d >2013-12-04 08:36:13,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 337c672d >2013-12-04 08:36:13,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 677c4f00 >2013-12-04 08:36:13,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9de3114e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ad5e09d}, log id: 677c4f00 >2013-12-04 08:36:18,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a06324c >2013-12-04 08:36:19,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4a06324c >2013-12-04 08:36:19,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d6cfaf >2013-12-04 08:36:19,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56e46cfa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36dff774}, log id: 7d6cfaf >2013-12-04 08:36:24,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 736b7cf7 >2013-12-04 08:36:24,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 736b7cf7 >2013-12-04 08:36:24,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5dca007a >2013-12-04 08:36:25,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3928a4ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e8fa55f}, log id: 5dca007a >2013-12-04 08:36:30,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 400d1c0d >2013-12-04 08:36:30,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 400d1c0d >2013-12-04 08:36:30,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 186c21bd >2013-12-04 08:36:30,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b370bb6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9ad9556}, log id: 186c21bd >2013-12-04 08:36:34,046 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) No up server in cluster >2013-12-04 08:36:34,046 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:36:34,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ec98819 >2013-12-04 08:36:34,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterTasksListVDSCommand, return: [], log id: ec98819 >2013-12-04 08:36:35,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f9695b3 >2013-12-04 08:36:36,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1f9695b3 >2013-12-04 08:36:36,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 75f56e5a >2013-12-04 08:36:36,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b0d29b0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea5235eb}, log id: 75f56e5a >2013-12-04 08:36:41,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45a099ca >2013-12-04 08:36:42,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 45a099ca >2013-12-04 08:36:42,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 616eac2c >2013-12-04 08:36:42,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@363850e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e652b2d5}, log id: 616eac2c >2013-12-04 08:36:47,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1d82b773 >2013-12-04 08:36:47,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d82b773 >2013-12-04 08:36:47,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 33c7a3c7 >2013-12-04 08:36:48,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70169349, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b05b2654}, log id: 33c7a3c7 >2013-12-04 08:36:53,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9c8dca8 >2013-12-04 08:36:53,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 9c8dca8 >2013-12-04 08:36:53,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 202e5c56 >2013-12-04 08:36:54,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37b11f19, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6509fed}, log id: 202e5c56 >2013-12-04 08:36:59,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1bbf51a6 >2013-12-04 08:36:59,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bbf51a6 >2013-12-04 08:36:59,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6da8e5cf >2013-12-04 08:36:59,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@939f0cdf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35604d1b}, log id: 6da8e5cf >2013-12-04 08:37:04,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ffc41db >2013-12-04 08:37:05,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: ffc41db >2013-12-04 08:37:05,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a8631c1 >2013-12-04 08:37:05,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96288bf2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbd1fbaf}, log id: a8631c1 >2013-12-04 08:37:10,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 18de15aa >2013-12-04 08:37:11,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 18de15aa >2013-12-04 08:37:11,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 53876447 >2013-12-04 08:37:11,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddec4641, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4f8432a}, log id: 53876447 >2013-12-04 08:37:16,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22c83a5e >2013-12-04 08:37:17,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 22c83a5e >2013-12-04 08:37:17,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67843da1 >2013-12-04 08:37:17,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@781c1c68, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f469eb5}, log id: 67843da1 >2013-12-04 08:37:22,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2514d2f6 >2013-12-04 08:37:22,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2514d2f6 >2013-12-04 08:37:22,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6daad479 >2013-12-04 08:37:23,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e91c5c7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e03ed1a}, log id: 6daad479 >2013-12-04 08:37:28,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 693d04c6 >2013-12-04 08:37:28,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 693d04c6 >2013-12-04 08:37:28,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2c1da529 >2013-12-04 08:37:28,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb44e1d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b8102ae}, log id: 2c1da529 >2013-12-04 08:37:33,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27ead8a >2013-12-04 08:37:34,385 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-04 08:37:34,385 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:37:34,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7098566b >2013-12-04 08:37:34,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 27ead8a >2013-12-04 08:37:34,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c770655 >2013-12-04 08:37:34,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7098566b >2013-12-04 08:37:34,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97fb97c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f6e8c59}, log id: 2c770655 >2013-12-04 08:37:39,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7fe1709c >2013-12-04 08:37:40,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fe1709c >2013-12-04 08:37:40,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 74becd47 >2013-12-04 08:37:40,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef08635a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9cd9baa}, log id: 74becd47 >2013-12-04 08:37:45,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2b43be08 >2013-12-04 08:37:46,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b43be08 >2013-12-04 08:37:46,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2ddced28 >2013-12-04 08:37:46,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c47823a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f9535b0}, log id: 2ddced28 >2013-12-04 08:37:51,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59851902 >2013-12-04 08:37:51,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 59851902 >2013-12-04 08:37:51,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f941ebf >2013-12-04 08:37:52,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84408bb6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea873345}, log id: 5f941ebf >2013-12-04 08:37:57,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: d98cd33 >2013-12-04 08:37:57,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: d98cd33 >2013-12-04 08:37:57,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 23d99cb0 >2013-12-04 08:37:58,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd1ba777, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35d71e95}, log id: 23d99cb0 >2013-12-04 08:38:03,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5aaf4698 >2013-12-04 08:38:03,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5aaf4698 >2013-12-04 08:38:03,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: cbe63c5 >2013-12-04 08:38:03,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4b2af18, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@803b8f0b}, log id: cbe63c5 >2013-12-04 08:38:08,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5a8650bf >2013-12-04 08:38:09,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5a8650bf >2013-12-04 08:38:09,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18b49644 >2013-12-04 08:38:09,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2989e283, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8200de4}, log id: 18b49644 >2013-12-04 08:38:14,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 50125d3c >2013-12-04 08:38:15,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 50125d3c >2013-12-04 08:38:15,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 751bd342 >2013-12-04 08:38:15,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e509a0a4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@395c7fcd}, log id: 751bd342 >2013-12-04 08:38:20,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 62497b3d >2013-12-04 08:38:21,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 62497b3d >2013-12-04 08:38:21,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6349c457 >2013-12-04 08:38:21,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe544378, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2e712eb}, log id: 6349c457 >2013-12-04 08:38:26,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36dae286 >2013-12-04 08:38:26,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 36dae286 >2013-12-04 08:38:26,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 165b0fa9 >2013-12-04 08:38:27,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd6aeab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f392a39}, log id: 165b0fa9 >2013-12-04 08:38:32,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4c5a59a8 >2013-12-04 08:38:32,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4c5a59a8 >2013-12-04 08:38:32,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3592fb72 >2013-12-04 08:38:32,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94f65010, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acfe4c93}, log id: 3592fb72 >2013-12-04 08:38:34,696 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-04 08:38:34,696 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:38:34,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ddbbf58 >2013-12-04 08:38:34,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3ddbbf58 >2013-12-04 08:38:36,866 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VMs/Templates Ovf. >2013-12-04 08:38:36,974 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-69) [73a35da9] Start refreshing all users data >2013-12-04 08:38:38,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 411ca197 >2013-12-04 08:38:38,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 411ca197 >2013-12-04 08:38:38,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 791847ce >2013-12-04 08:38:38,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@219003b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dec7f7f}, log id: 791847ce >2013-12-04 08:38:39,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-42) START, GlusterHooksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 378cc138 >2013-12-04 08:38:39,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-14) START, GlusterHooksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7122afa1 >2013-12-04 08:38:39,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) START, GlusterHooksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 79e16005 >2013-12-04 08:38:39,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-25) START, GlusterHooksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b6726c6 >2013-12-04 08:38:39,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3d2df058, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@1295ffb8, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@16171091, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c8e6d357, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@87bfc805, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@74c20c4b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a6500214], log id: 79e16005 >2013-12-04 08:38:39,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-42) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@8c79d8a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@bfcab073, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d95f97b8, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d09786b9, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2b6acdb1, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@7deb0f27, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6750e99c], log id: 378cc138 >2013-12-04 08:38:39,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-14) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@bd97d85f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@267f5a6d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f41cd0a3, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a9cfc4ac, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@36961991, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@88250e01, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6da3fb5b], log id: 7122afa1 >2013-12-04 08:38:39,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-25) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@99ecf11e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ba304bed, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3eed1cfc, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f1a91672, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@55823e8d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@da12bb25, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@e947cf22], log id: 3b6726c6 >2013-12-04 08:38:43,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 38edd7c3 >2013-12-04 08:38:44,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 38edd7c3 >2013-12-04 08:38:44,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 560748 >2013-12-04 08:38:44,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a849406f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad3eb4bf}, log id: 560748 >2013-12-04 08:38:49,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2bc15a9 >2013-12-04 08:38:50,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2bc15a9 >2013-12-04 08:38:50,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f858db9 >2013-12-04 08:38:50,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cb28f24, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@649d2593}, log id: 4f858db9 >2013-12-04 08:38:55,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28801bf6 >2013-12-04 08:38:55,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 28801bf6 >2013-12-04 08:38:55,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5e936167 >2013-12-04 08:38:56,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc7df673, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e15bbf9}, log id: 5e936167 >2013-12-04 08:39:01,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50de8fcf >2013-12-04 08:39:01,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 50de8fcf >2013-12-04 08:39:01,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 739e79a0 >2013-12-04 08:39:02,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70938e13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb0fa3cf}, log id: 739e79a0 >2013-12-04 08:39:07,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4ea7da8e >2013-12-04 08:39:07,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ea7da8e >2013-12-04 08:39:07,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7dcee541 >2013-12-04 08:39:07,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@111e2547, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2451fc}, log id: 7dcee541 >2013-12-04 08:39:12,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 31f9fc8 >2013-12-04 08:39:13,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 31f9fc8 >2013-12-04 08:39:13,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3b327eb0 >2013-12-04 08:39:13,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d7e7ed2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7eec5a13}, log id: 3b327eb0 >2013-12-04 08:39:18,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6feac29e >2013-12-04 08:39:19,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6feac29e >2013-12-04 08:39:19,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36869f35 >2013-12-04 08:39:19,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94935167, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77e5b5a5}, log id: 36869f35 >2013-12-04 08:39:24,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 77215c8d >2013-12-04 08:39:25,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 77215c8d >2013-12-04 08:39:25,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 60a9f3e1 >2013-12-04 08:39:25,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb74d03f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1cf32cb}, log id: 60a9f3e1 >2013-12-04 08:39:26,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 20b91d09 >2013-12-04 08:39:26,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@75ea3ac5, log id: 20b91d09 >2013-12-04 08:39:26,706 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-26) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:39:26,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 64b897fd >2013-12-04 08:39:26,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7eaa7b78, log id: 64b897fd >2013-12-04 08:39:30,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50c35a0d >2013-12-04 08:39:30,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 50c35a0d >2013-12-04 08:39:30,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63963c10 >2013-12-04 08:39:31,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a5ac87b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4355dde}, log id: 63963c10 >2013-12-04 08:39:34,988 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2013-12-04 08:39:34,989 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:39:35,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7efe7c56 >2013-12-04 08:39:35,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7efe7c56 >2013-12-04 08:39:36,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5295bdfe >2013-12-04 08:39:36,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5295bdfe >2013-12-04 08:39:36,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7e5ee43a >2013-12-04 08:39:36,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a9bc5a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@233a231f}, log id: 7e5ee43a >2013-12-04 08:39:41,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 36679eab >2013-12-04 08:39:42,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36679eab >2013-12-04 08:39:42,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4a538ffe >2013-12-04 08:39:42,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53844cc0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a7a0eb4}, log id: 4a538ffe >2013-12-04 08:39:47,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 14d483c9 >2013-12-04 08:39:48,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 14d483c9 >2013-12-04 08:39:48,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6992820b >2013-12-04 08:39:48,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9a913be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f7d4d2f}, log id: 6992820b >2013-12-04 08:39:53,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 41c3dee4 >2013-12-04 08:39:54,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 41c3dee4 >2013-12-04 08:39:54,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 9d983ca >2013-12-04 08:39:54,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@692116fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@498133e4}, log id: 9d983ca >2013-12-04 08:39:59,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 692b9c03 >2013-12-04 08:39:59,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 692b9c03 >2013-12-04 08:39:59,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 16656b12 >2013-12-04 08:40:00,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77841e67, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cd61bdf}, log id: 16656b12 >2013-12-04 08:40:05,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 44b67eb1 >2013-12-04 08:40:05,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 44b67eb1 >2013-12-04 08:40:05,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2fdc707e >2013-12-04 08:40:05,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a197836, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@742b32ce}, log id: 2fdc707e >2013-12-04 08:40:11,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7f5cb466 >2013-12-04 08:40:11,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f5cb466 >2013-12-04 08:40:11,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 45698bcb >2013-12-04 08:40:11,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b99deb7a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97df6b30}, log id: 45698bcb >2013-12-04 08:40:16,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6950018b >2013-12-04 08:40:17,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6950018b >2013-12-04 08:40:17,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: cf179db >2013-12-04 08:40:17,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c3e1d6b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe1794ca}, log id: cf179db >2013-12-04 08:40:22,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53a5667c >2013-12-04 08:40:23,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 53a5667c >2013-12-04 08:40:23,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27c81752 >2013-12-04 08:40:23,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db4b1e3a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5ed43dd}, log id: 27c81752 >2013-12-04 08:40:28,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f88e11e >2013-12-04 08:40:28,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5f88e11e >2013-12-04 08:40:28,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 738d5d0f >2013-12-04 08:40:29,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be668cd1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28d59594}, log id: 738d5d0f >2013-12-04 08:40:34,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: cedab9d >2013-12-04 08:40:34,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: cedab9d >2013-12-04 08:40:34,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 40c5542 >2013-12-04 08:40:35,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ec6e74c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80c62b88}, log id: 40c5542 >2013-12-04 08:40:35,288 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) No up server in cluster >2013-12-04 08:40:35,288 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:40:35,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 61e570e3 >2013-12-04 08:40:35,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterTasksListVDSCommand, return: [], log id: 61e570e3 >2013-12-04 08:40:40,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 396897cc >2013-12-04 08:40:40,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 396897cc >2013-12-04 08:40:40,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6599ab4f >2013-12-04 08:40:40,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2412e1f4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4ad649c}, log id: 6599ab4f >2013-12-04 08:40:45,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c5c7042 >2013-12-04 08:40:46,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5c5c7042 >2013-12-04 08:40:46,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4519bb37 >2013-12-04 08:40:46,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@387238dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce1b047d}, log id: 4519bb37 >2013-12-04 08:40:51,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 40fe4630 >2013-12-04 08:40:52,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 40fe4630 >2013-12-04 08:40:52,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 486adb74 >2013-12-04 08:40:52,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e190c35f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b7e4f2}, log id: 486adb74 >2013-12-04 08:40:57,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 31657676 >2013-12-04 08:40:58,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 31657676 >2013-12-04 08:40:58,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41c0555d >2013-12-04 08:40:58,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8ef303c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b40f792d}, log id: 41c0555d >2013-12-04 08:41:03,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1203423 >2013-12-04 08:41:03,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1203423 >2013-12-04 08:41:03,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4219120d >2013-12-04 08:41:04,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7261f3d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f647c8ad}, log id: 4219120d >2013-12-04 08:41:09,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26662ca9 >2013-12-04 08:41:09,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 26662ca9 >2013-12-04 08:41:09,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73ba7e05 >2013-12-04 08:41:10,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93962305, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@232b0eee}, log id: 73ba7e05 >2013-12-04 08:41:15,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 414fffc5 >2013-12-04 08:41:15,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 414fffc5 >2013-12-04 08:41:15,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 620db6c2 >2013-12-04 08:41:15,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba152b21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d008a6f8}, log id: 620db6c2 >2013-12-04 08:41:20,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7abc53e9 >2013-12-04 08:41:21,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7abc53e9 >2013-12-04 08:41:21,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 302226be >2013-12-04 08:41:21,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b2b492e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa3d004f}, log id: 302226be >2013-12-04 08:41:26,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7823e75f >2013-12-04 08:41:27,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7823e75f >2013-12-04 08:41:27,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48c6cbba >2013-12-04 08:41:27,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6afbbf8f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4027537e}, log id: 48c6cbba >2013-12-04 08:41:32,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7554b646 >2013-12-04 08:41:33,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7554b646 >2013-12-04 08:41:33,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e2ac7d0 >2013-12-04 08:41:33,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3342295d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1bcbc9f}, log id: 7e2ac7d0 >2013-12-04 08:41:35,596 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-04 08:41:35,596 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:41:35,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: bc51b74 >2013-12-04 08:41:35,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: bc51b74 >2013-12-04 08:41:38,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1f59dd86 >2013-12-04 08:41:38,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f59dd86 >2013-12-04 08:41:38,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6a3a67b0 >2013-12-04 08:41:39,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f01c179e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f17f8a6}, log id: 6a3a67b0 >2013-12-04 08:41:44,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 71c6227d >2013-12-04 08:41:44,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 71c6227d >2013-12-04 08:41:44,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63ae63a8 >2013-12-04 08:41:45,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15ab9155, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25520429}, log id: 63ae63a8 >2013-12-04 08:41:50,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 62c79330 >2013-12-04 08:41:50,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 62c79330 >2013-12-04 08:41:50,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 657fa6d7 >2013-12-04 08:41:50,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4670e159, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b633815}, log id: 657fa6d7 >2013-12-04 08:41:55,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2310045c >2013-12-04 08:41:56,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2310045c >2013-12-04 08:41:56,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e511fd4 >2013-12-04 08:41:56,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae1536b0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48b74a04}, log id: 4e511fd4 >2013-12-04 08:42:01,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5f8f4fec >2013-12-04 08:42:02,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f8f4fec >2013-12-04 08:42:02,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 8ae43a7 >2013-12-04 08:42:02,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6e9e546, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21950943}, log id: 8ae43a7 >2013-12-04 08:42:07,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 336be9b9 >2013-12-04 08:42:08,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 336be9b9 >2013-12-04 08:42:08,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 151c597c >2013-12-04 08:42:08,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdc9c380, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dd4762c}, log id: 151c597c >2013-12-04 08:42:13,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2fa0857a >2013-12-04 08:42:13,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2fa0857a >2013-12-04 08:42:13,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 8fc6cb3 >2013-12-04 08:42:14,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f5526f6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@741ae7e3}, log id: 8fc6cb3 >2013-12-04 08:42:19,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 516deb9f >2013-12-04 08:42:19,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 516deb9f >2013-12-04 08:42:19,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54154c4d >2013-12-04 08:42:19,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1464ce6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b53c53d4}, log id: 54154c4d >2013-12-04 08:42:25,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6940dd7d >2013-12-04 08:42:25,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6940dd7d >2013-12-04 08:42:25,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 614a9150 >2013-12-04 08:42:25,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b03ba22, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@642f46b2}, log id: 614a9150 >2013-12-04 08:42:30,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e4ab2fd >2013-12-04 08:42:31,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1e4ab2fd >2013-12-04 08:42:31,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 34bba634 >2013-12-04 08:42:31,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9858c4a1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfaf15d9}, log id: 34bba634 >2013-12-04 08:42:35,913 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) [1f2a7840] No up server in cluster >2013-12-04 08:42:35,914 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) [1f2a7840] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:42:35,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3c95513b >2013-12-04 08:42:36,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3c95513b >2013-12-04 08:42:36,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75a14b9b >2013-12-04 08:42:37,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 75a14b9b >2013-12-04 08:42:37,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45bdd2f2 >2013-12-04 08:42:37,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33bc16fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@256a63d3}, log id: 45bdd2f2 >2013-12-04 08:42:42,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1044cf54 >2013-12-04 08:42:42,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1044cf54 >2013-12-04 08:42:42,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f3ba953 >2013-12-04 08:42:43,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@607cf9c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1713db4}, log id: f3ba953 >2013-12-04 08:42:48,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 487fa7d5 >2013-12-04 08:42:48,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 487fa7d5 >2013-12-04 08:42:48,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e9841a6 >2013-12-04 08:42:49,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f67e276e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b91da23}, log id: 7e9841a6 >2013-12-04 08:42:54,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: bb3e4c9 >2013-12-04 08:42:54,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: bb3e4c9 >2013-12-04 08:42:54,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c0865d9 >2013-12-04 08:42:54,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dea6f07f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e7f4114}, log id: 5c0865d9 >2013-12-04 08:42:59,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29d555ef >2013-12-04 08:43:00,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 29d555ef >2013-12-04 08:43:00,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5d910582 >2013-12-04 08:43:00,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da850175, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a98d47}, log id: 5d910582 >2013-12-04 08:43:05,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45e25b4f >2013-12-04 08:43:06,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 45e25b4f >2013-12-04 08:43:06,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5729e52c >2013-12-04 08:43:06,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ba77a03, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9408c941}, log id: 5729e52c >2013-12-04 08:43:11,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 65603407 >2013-12-04 08:43:12,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 65603407 >2013-12-04 08:43:12,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 449c09c3 >2013-12-04 08:43:12,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fc288b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96ef8e9e}, log id: 449c09c3 >2013-12-04 08:43:17,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 37e271ca >2013-12-04 08:43:17,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 37e271ca >2013-12-04 08:43:17,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5a88369e >2013-12-04 08:43:18,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8763f0c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56111f40}, log id: 5a88369e >2013-12-04 08:43:23,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 22c4582 >2013-12-04 08:43:23,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 22c4582 >2013-12-04 08:43:23,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4aa9645e >2013-12-04 08:43:24,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24c4b2d2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38298596}, log id: 4aa9645e >2013-12-04 08:43:29,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: f13afc >2013-12-04 08:43:29,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: f13afc >2013-12-04 08:43:29,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6cd04f75 >2013-12-04 08:43:29,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e43181b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f2303ac}, log id: 6cd04f75 >2013-12-04 08:43:34,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7ddbd5ca >2013-12-04 08:43:35,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ddbd5ca >2013-12-04 08:43:35,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 44981d11 >2013-12-04 08:43:35,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67f3f2de, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23e4c23}, log id: 44981d11 >2013-12-04 08:43:36,222 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) No up server in cluster >2013-12-04 08:43:36,223 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:43:36,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: af8dcdd >2013-12-04 08:43:36,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterTasksListVDSCommand, return: [], log id: af8dcdd >2013-12-04 08:43:40,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 415e636b >2013-12-04 08:43:41,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 415e636b >2013-12-04 08:43:41,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b2b783b >2013-12-04 08:43:41,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfc66f53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a8ba289}, log id: 3b2b783b >2013-12-04 08:43:46,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35ba0134 >2013-12-04 08:43:47,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 35ba0134 >2013-12-04 08:43:47,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45cfc806 >2013-12-04 08:43:47,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b2fd71d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dc8097d}, log id: 45cfc806 >2013-12-04 08:43:52,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d9dd02a >2013-12-04 08:43:52,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6d9dd02a >2013-12-04 08:43:52,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 44b74a8b >2013-12-04 08:43:53,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61c06fa1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@779bb303}, log id: 44b74a8b >2013-12-04 08:43:58,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 284d780f >2013-12-04 08:43:58,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 284d780f >2013-12-04 08:43:58,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2032c505 >2013-12-04 08:43:58,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c1edd35, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14b03141}, log id: 2032c505 >2013-12-04 08:44:03,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f283782 >2013-12-04 08:44:04,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f283782 >2013-12-04 08:44:04,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f0a5114 >2013-12-04 08:44:04,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6506db6d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c1c2464}, log id: 4f0a5114 >2013-12-04 08:44:09,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 58720fd9 >2013-12-04 08:44:10,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 58720fd9 >2013-12-04 08:44:10,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4fa13670 >2013-12-04 08:44:10,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2550c6f3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d65e115}, log id: 4fa13670 >2013-12-04 08:44:15,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67f9babb >2013-12-04 08:44:16,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 67f9babb >2013-12-04 08:44:16,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ab5e7c >2013-12-04 08:44:16,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@929888f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b316c28c}, log id: 5ab5e7c >2013-12-04 08:44:21,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78d02567 >2013-12-04 08:44:21,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 78d02567 >2013-12-04 08:44:21,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c74b33e >2013-12-04 08:44:22,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14d6fdc7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6e6cc94}, log id: 1c74b33e >2013-12-04 08:44:27,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 504f768 >2013-12-04 08:44:27,283 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-36) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:44:27,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@c33b9f9, log id: 504f768 >2013-12-04 08:44:27,309 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-84) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:44:27,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 17f690b1 >2013-12-04 08:44:27,328 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-84) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:44:27,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 17f690b1 >2013-12-04 08:44:27,838 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-84) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 08:44:27,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 45db0239 >2013-12-04 08:44:28,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87ef34ac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f38a33c1}, log id: 45db0239 >2013-12-04 08:44:28,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 332ae011 >2013-12-04 08:44:28,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1a98807e, log id: 332ae011 >2013-12-04 08:44:33,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54ff7c2e >2013-12-04 08:44:33,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 54ff7c2e >2013-12-04 08:44:33,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 651954dc >2013-12-04 08:44:33,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7400fcc5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6000ca1f}, log id: 651954dc >2013-12-04 08:44:36,537 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) No up server in cluster >2013-12-04 08:44:36,537 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:44:36,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3963c299 >2013-12-04 08:44:36,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3963c299 >2013-12-04 08:44:38,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ad574a >2013-12-04 08:44:39,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5ad574a >2013-12-04 08:44:39,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4be1ba53 >2013-12-04 08:44:39,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c21f0ab5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca00dd6}, log id: 4be1ba53 >2013-12-04 08:44:44,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c14706a >2013-12-04 08:44:45,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3c14706a >2013-12-04 08:44:45,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d404604 >2013-12-04 08:44:45,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fb59533, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d410699}, log id: 2d404604 >2013-12-04 08:44:50,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4075550f >2013-12-04 08:44:51,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4075550f >2013-12-04 08:44:51,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d00faa2 >2013-12-04 08:44:51,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c2e62e8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a5fd240}, log id: 3d00faa2 >2013-12-04 08:44:56,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 228b8b2b >2013-12-04 08:44:56,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 228b8b2b >2013-12-04 08:44:56,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2bf98639 >2013-12-04 08:44:57,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6020627, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38064d19}, log id: 2bf98639 >2013-12-04 08:45:02,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 188f6d2a >2013-12-04 08:45:02,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 188f6d2a >2013-12-04 08:45:02,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 563d7eb6 >2013-12-04 08:45:02,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9d1646d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5d1cd3}, log id: 563d7eb6 >2013-12-04 08:45:08,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: f671dae >2013-12-04 08:45:08,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: f671dae >2013-12-04 08:45:08,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4f195016 >2013-12-04 08:45:08,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83396aeb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f1567d5}, log id: 4f195016 >2013-12-04 08:45:13,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 56738411 >2013-12-04 08:45:14,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 56738411 >2013-12-04 08:45:14,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 525e6348 >2013-12-04 08:45:14,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75bf6758, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84b316ac}, log id: 525e6348 >2013-12-04 08:45:19,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6331df34 >2013-12-04 08:45:20,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6331df34 >2013-12-04 08:45:20,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 594c9287 >2013-12-04 08:45:20,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39c72c2b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff2a98e9}, log id: 594c9287 >2013-12-04 08:45:25,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4fd7fa0a >2013-12-04 08:45:26,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4fd7fa0a >2013-12-04 08:45:26,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e374bc3 >2013-12-04 08:45:26,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69ca06e2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10f37c41}, log id: 4e374bc3 >2013-12-04 08:45:31,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7703bdda >2013-12-04 08:45:31,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7703bdda >2013-12-04 08:45:31,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 460c0086 >2013-12-04 08:45:32,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3e8b221, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ac48c49}, log id: 460c0086 >2013-12-04 08:45:36,847 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) No up server in cluster >2013-12-04 08:45:36,847 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:45:36,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 63d2eaa >2013-12-04 08:45:37,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterTasksListVDSCommand, return: [], log id: 63d2eaa >2013-12-04 08:45:37,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f8383dd >2013-12-04 08:45:37,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4f8383dd >2013-12-04 08:45:37,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12b752c8 >2013-12-04 08:45:37,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6268fcf0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@674deed5}, log id: 12b752c8 >2013-12-04 08:45:43,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45c4e885 >2013-12-04 08:45:43,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 45c4e885 >2013-12-04 08:45:43,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2cd1d75f >2013-12-04 08:45:43,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfe4753b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@943d1a5a}, log id: 2cd1d75f >2013-12-04 08:45:48,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 408e7ef3 >2013-12-04 08:45:49,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 408e7ef3 >2013-12-04 08:45:49,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6d9d4233 >2013-12-04 08:45:49,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e07b17a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3a12643}, log id: 6d9d4233 >2013-12-04 08:45:54,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ae39b2c >2013-12-04 08:45:55,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3ae39b2c >2013-12-04 08:45:55,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b65b8cc >2013-12-04 08:45:55,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac099b29, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44b0c6bd}, log id: 5b65b8cc >2013-12-04 08:46:00,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7d5391c9 >2013-12-04 08:46:00,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d5391c9 >2013-12-04 08:46:00,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 18778764 >2013-12-04 08:46:01,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@785b07f0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4332973}, log id: 18778764 >2013-12-04 08:46:06,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5bc211ce >2013-12-04 08:46:06,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5bc211ce >2013-12-04 08:46:06,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 284a1c00 >2013-12-04 08:46:07,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8cbf305, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f08a8983}, log id: 284a1c00 >2013-12-04 08:46:12,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 61d10b97 >2013-12-04 08:46:12,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 61d10b97 >2013-12-04 08:46:12,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3a697dc >2013-12-04 08:46:12,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8695f306, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@122f692c}, log id: 3a697dc >2013-12-04 08:46:17,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b00bc5a >2013-12-04 08:46:18,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b00bc5a >2013-12-04 08:46:18,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b41c7f8 >2013-12-04 08:46:18,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e83867ac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@129c6f4}, log id: 1b41c7f8 >2013-12-04 08:46:23,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ace8124 >2013-12-04 08:46:24,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6ace8124 >2013-12-04 08:46:24,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2744e575 >2013-12-04 08:46:24,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa3736ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d31f55c}, log id: 2744e575 >2013-12-04 08:46:29,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2912e29a >2013-12-04 08:46:30,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2912e29a >2013-12-04 08:46:30,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7e47b4dc >2013-12-04 08:46:30,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f8291f3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@331b5b09}, log id: 7e47b4dc >2013-12-04 08:46:35,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3509dd73 >2013-12-04 08:46:35,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3509dd73 >2013-12-04 08:46:35,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 790246ec >2013-12-04 08:46:36,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b5f9089, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a08f7a7}, log id: 790246ec >2013-12-04 08:46:37,157 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-04 08:46:37,157 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:46:37,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7726cc9a >2013-12-04 08:46:37,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7726cc9a >2013-12-04 08:46:41,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6fe75302 >2013-12-04 08:46:41,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6fe75302 >2013-12-04 08:46:41,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e2e897d >2013-12-04 08:46:41,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65ac85aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa36b204}, log id: 3e2e897d >2013-12-04 08:46:46,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3638727e >2013-12-04 08:46:47,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3638727e >2013-12-04 08:46:47,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58af4c2e >2013-12-04 08:46:47,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0cec97c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23d942cc}, log id: 58af4c2e >2013-12-04 08:46:52,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1603be74 >2013-12-04 08:46:53,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1603be74 >2013-12-04 08:46:53,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ba45d7f >2013-12-04 08:46:53,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f844326, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@614d2ed2}, log id: 7ba45d7f >2013-12-04 08:46:58,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2e3e4730 >2013-12-04 08:46:59,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e3e4730 >2013-12-04 08:46:59,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3b58d91 >2013-12-04 08:46:59,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac3c70e1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8014479}, log id: 3b58d91 >2013-12-04 08:47:04,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 57af10da >2013-12-04 08:47:04,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 57af10da >2013-12-04 08:47:04,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3de46331 >2013-12-04 08:47:05,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3daa3f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b11f08}, log id: 3de46331 >2013-12-04 08:47:10,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39f8f502 >2013-12-04 08:47:10,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 39f8f502 >2013-12-04 08:47:10,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6f7d6a1e >2013-12-04 08:47:10,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6daf81b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e437e576}, log id: 6f7d6a1e >2013-12-04 08:47:16,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 300cb55f >2013-12-04 08:47:16,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 300cb55f >2013-12-04 08:47:16,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 33b38b0b >2013-12-04 08:47:16,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aabf1291, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a37a4cd}, log id: 33b38b0b >2013-12-04 08:47:21,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 73bfa9d8 >2013-12-04 08:47:22,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 73bfa9d8 >2013-12-04 08:47:22,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 36f15502 >2013-12-04 08:47:22,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a159c0b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2952696}, log id: 36f15502 >2013-12-04 08:47:27,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4c6dd958 >2013-12-04 08:47:28,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4c6dd958 >2013-12-04 08:47:28,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 405d4169 >2013-12-04 08:47:28,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@946e4eb1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7e50a4f}, log id: 405d4169 >2013-12-04 08:47:33,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 522ba36d >2013-12-04 08:47:33,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 522ba36d >2013-12-04 08:47:33,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 50ed3285 >2013-12-04 08:47:34,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@822cf687, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f53590fa}, log id: 50ed3285 >2013-12-04 08:47:37,468 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-04 08:47:37,468 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:47:37,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1dbd0fb1 >2013-12-04 08:47:37,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1dbd0fb1 >2013-12-04 08:47:39,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7e5dcf93 >2013-12-04 08:47:39,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e5dcf93 >2013-12-04 08:47:39,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7eacef71 >2013-12-04 08:47:40,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ba1bd9c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61ff1e6f}, log id: 7eacef71 >2013-12-04 08:47:45,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6497a4e5 >2013-12-04 08:47:45,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6497a4e5 >2013-12-04 08:47:45,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 96200cc >2013-12-04 08:47:45,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e14c5d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fafdb452}, log id: 96200cc >2013-12-04 08:47:50,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2879ae88 >2013-12-04 08:47:51,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2879ae88 >2013-12-04 08:47:51,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 293532b8 >2013-12-04 08:47:51,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2778c9fa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@261f47a8}, log id: 293532b8 >2013-12-04 08:47:56,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f20dc5 >2013-12-04 08:47:57,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3f20dc5 >2013-12-04 08:47:57,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 25fdff53 >2013-12-04 08:47:57,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b7bce9a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdb33bab}, log id: 25fdff53 >2013-12-04 08:48:02,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 577c4890 >2013-12-04 08:48:03,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 577c4890 >2013-12-04 08:48:03,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3c36ceb8 >2013-12-04 08:48:03,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41096a21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7bb0de0}, log id: 3c36ceb8 >2013-12-04 08:48:08,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: bf0c7c1 >2013-12-04 08:48:08,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: bf0c7c1 >2013-12-04 08:48:08,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40cca305 >2013-12-04 08:48:09,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7219bf44, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65d3f2ea}, log id: 40cca305 >2013-12-04 08:48:14,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 50dc7a4 >2013-12-04 08:48:14,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 50dc7a4 >2013-12-04 08:48:14,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 488af853 >2013-12-04 08:48:15,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69ec49ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce1f8437}, log id: 488af853 >2013-12-04 08:48:20,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1835377a >2013-12-04 08:48:20,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1835377a >2013-12-04 08:48:20,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d579af5 >2013-12-04 08:48:20,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5024194e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9bf88b9}, log id: 2d579af5 >2013-12-04 08:48:25,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29080743 >2013-12-04 08:48:26,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 29080743 >2013-12-04 08:48:26,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 689857b1 >2013-12-04 08:48:26,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57147a20, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab9496db}, log id: 689857b1 >2013-12-04 08:48:31,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4bc07479 >2013-12-04 08:48:32,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4bc07479 >2013-12-04 08:48:32,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 15b8a3d4 >2013-12-04 08:48:32,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3b0a033, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a37f3442}, log id: 15b8a3d4 >2013-12-04 08:48:37,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4be8bfbb >2013-12-04 08:48:37,771 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) No up server in cluster >2013-12-04 08:48:37,772 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:48:37,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3c2cfda7 >2013-12-04 08:48:38,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3c2cfda7 >2013-12-04 08:48:38,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4be8bfbb >2013-12-04 08:48:38,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3cc66562 >2013-12-04 08:48:38,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81dd5a2f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d631a672}, log id: 3cc66562 >2013-12-04 08:48:43,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1dc924f4 >2013-12-04 08:48:43,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1dc924f4 >2013-12-04 08:48:43,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d31ccc5 >2013-12-04 08:48:44,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3e2bd0c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25f8d8d4}, log id: 5d31ccc5 >2013-12-04 08:48:49,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5654d8d9 >2013-12-04 08:48:49,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5654d8d9 >2013-12-04 08:48:49,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7180c4c9 >2013-12-04 08:48:49,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10d499b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a087f60d}, log id: 7180c4c9 >2013-12-04 08:48:55,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 126090c6 >2013-12-04 08:48:55,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 126090c6 >2013-12-04 08:48:55,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24ae8f26 >2013-12-04 08:48:55,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48b26af3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac08669}, log id: 24ae8f26 >2013-12-04 08:49:00,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 42805518 >2013-12-04 08:49:01,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 42805518 >2013-12-04 08:49:01,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4edbdbed >2013-12-04 08:49:01,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@964fccfb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0824429}, log id: 4edbdbed >2013-12-04 08:49:06,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 71e92661 >2013-12-04 08:49:07,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 71e92661 >2013-12-04 08:49:07,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6ed98897 >2013-12-04 08:49:07,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38d444cc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c607fa27}, log id: 6ed98897 >2013-12-04 08:49:12,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 38afc0ff >2013-12-04 08:49:12,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 38afc0ff >2013-12-04 08:49:12,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 967e4b6 >2013-12-04 08:49:13,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@967dca57, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f5e88f2}, log id: 967e4b6 >2013-12-04 08:49:18,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 35cca44b >2013-12-04 08:49:18,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 35cca44b >2013-12-04 08:49:18,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 447aba0f >2013-12-04 08:49:18,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8a685ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf9c7fb0}, log id: 447aba0f >2013-12-04 08:49:24,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ec65406 >2013-12-04 08:49:24,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3ec65406 >2013-12-04 08:49:24,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b666216 >2013-12-04 08:49:24,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2650939, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4ab5bcd}, log id: 2b666216 >2013-12-04 08:49:28,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7541a33e >2013-12-04 08:49:28,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7ad45ba2, log id: 7541a33e >2013-12-04 08:49:28,707 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-36) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:49:28,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: bcc27ae >2013-12-04 08:49:29,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@b5fba94, log id: bcc27ae >2013-12-04 08:49:29,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53684417 >2013-12-04 08:49:30,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 53684417 >2013-12-04 08:49:30,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 26af94f >2013-12-04 08:49:30,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fb2d91b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b5889fb}, log id: 26af94f >2013-12-04 08:49:35,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4a192b86 >2013-12-04 08:49:36,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a192b86 >2013-12-04 08:49:36,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 641ee49c >2013-12-04 08:49:36,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@754b485f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32192442}, log id: 641ee49c >2013-12-04 08:49:38,064 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) No up server in cluster >2013-12-04 08:49:38,065 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:49:38,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f2e520a >2013-12-04 08:49:38,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterTasksListVDSCommand, return: [], log id: f2e520a >2013-12-04 08:49:41,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 217cc092 >2013-12-04 08:49:41,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 217cc092 >2013-12-04 08:49:41,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5ddf680b >2013-12-04 08:49:42,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a325cecd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfa3bf91}, log id: 5ddf680b >2013-12-04 08:49:47,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73a4e315 >2013-12-04 08:49:47,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 73a4e315 >2013-12-04 08:49:47,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4c93a601 >2013-12-04 08:49:48,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e7fb307, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40362387}, log id: 4c93a601 >2013-12-04 08:49:53,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6173b703 >2013-12-04 08:49:53,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6173b703 >2013-12-04 08:49:53,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f02d36a >2013-12-04 08:49:54,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86cd801b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f810ae8c}, log id: 1f02d36a >2013-12-04 08:49:59,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e68f920 >2013-12-04 08:49:59,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3e68f920 >2013-12-04 08:49:59,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9c97169 >2013-12-04 08:50:00,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9524e524, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3262cf9a}, log id: 9c97169 >2013-12-04 08:50:05,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: b293ef4 >2013-12-04 08:50:05,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: b293ef4 >2013-12-04 08:50:05,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48569f76 >2013-12-04 08:50:05,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42b9b593, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c47f7d77}, log id: 48569f76 >2013-12-04 08:50:10,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: c125898 >2013-12-04 08:50:11,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: c125898 >2013-12-04 08:50:11,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7539e31f >2013-12-04 08:50:11,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6ed3784, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@196029f1}, log id: 7539e31f >2013-12-04 08:50:16,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 72c2337e >2013-12-04 08:50:17,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 72c2337e >2013-12-04 08:50:17,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a1ed7b0 >2013-12-04 08:50:17,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f310ad01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cf5775b}, log id: 5a1ed7b0 >2013-12-04 08:50:22,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 11babaaf >2013-12-04 08:50:23,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 11babaaf >2013-12-04 08:50:23,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5aefb598 >2013-12-04 08:50:23,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4eda6283, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bc8e3ac}, log id: 5aefb598 >2013-12-04 08:50:28,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2caeb3cf >2013-12-04 08:50:28,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2caeb3cf >2013-12-04 08:50:28,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7866e667 >2013-12-04 08:50:29,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@299cb700, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6d43e39}, log id: 7866e667 >2013-12-04 08:50:34,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5d09a1b4 >2013-12-04 08:50:34,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5d09a1b4 >2013-12-04 08:50:34,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e6fcb82 >2013-12-04 08:50:35,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef7e83a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85343804}, log id: e6fcb82 >2013-12-04 08:50:38,374 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-04 08:50:38,375 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:50:38,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73beb754 >2013-12-04 08:50:38,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 73beb754 >2013-12-04 08:50:40,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 24dbea3a >2013-12-04 08:50:40,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 24dbea3a >2013-12-04 08:50:40,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6635ddc9 >2013-12-04 08:50:40,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a792a844, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d341192}, log id: 6635ddc9 >2013-12-04 08:50:45,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3c44ee7d >2013-12-04 08:50:46,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c44ee7d >2013-12-04 08:50:46,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 587270c6 >2013-12-04 08:50:46,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9110546, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de53be53}, log id: 587270c6 >2013-12-04 08:50:51,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d7e4973 >2013-12-04 08:50:52,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7d7e4973 >2013-12-04 08:50:52,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6fa7be92 >2013-12-04 08:50:52,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fd63504, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3eab35c}, log id: 6fa7be92 >2013-12-04 08:50:57,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 56eeda7c >2013-12-04 08:50:58,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 56eeda7c >2013-12-04 08:50:58,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6809ab1e >2013-12-04 08:50:58,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f8fef48, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcdc2d16}, log id: 6809ab1e >2013-12-04 08:51:03,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: e316b3c >2013-12-04 08:51:03,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: e316b3c >2013-12-04 08:51:03,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4ae78704 >2013-12-04 08:51:04,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e7fe04d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a38e159f}, log id: 4ae78704 >2013-12-04 08:51:09,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7382fdef >2013-12-04 08:51:09,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7382fdef >2013-12-04 08:51:09,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 546d950b >2013-12-04 08:51:09,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@823a07fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ee9514e}, log id: 546d950b >2013-12-04 08:51:14,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9edf482 >2013-12-04 08:51:15,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 9edf482 >2013-12-04 08:51:15,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 264bf1c5 >2013-12-04 08:51:15,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@395549b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@439ab4b1}, log id: 264bf1c5 >2013-12-04 08:51:20,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d83bb91 >2013-12-04 08:51:21,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1d83bb91 >2013-12-04 08:51:21,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fd02983 >2013-12-04 08:51:21,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc6417af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89bdf59f}, log id: 2fd02983 >2013-12-04 08:51:26,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 269aedab >2013-12-04 08:51:27,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 269aedab >2013-12-04 08:51:27,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3ab75937 >2013-12-04 08:51:27,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1dc54702, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1e4fd04}, log id: 3ab75937 >2013-12-04 08:51:32,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 53ef69b6 >2013-12-04 08:51:32,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 53ef69b6 >2013-12-04 08:51:32,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3c37c666 >2013-12-04 08:51:33,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59834ca7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a6e5c1}, log id: 3c37c666 >2013-12-04 08:51:38,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6206b20b >2013-12-04 08:51:38,692 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-04 08:51:38,693 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:51:38,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3192e5a6 >2013-12-04 08:51:38,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6206b20b >2013-12-04 08:51:38,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70a14c7 >2013-12-04 08:51:38,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3192e5a6 >2013-12-04 08:51:39,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75af8ee5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e20969bd}, log id: 70a14c7 >2013-12-04 08:51:44,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6472944c >2013-12-04 08:51:44,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6472944c >2013-12-04 08:51:44,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d9a91c8 >2013-12-04 08:51:44,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eefaa751, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f0c80bc}, log id: 6d9a91c8 >2013-12-04 08:51:49,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d7db4de >2013-12-04 08:51:50,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2d7db4de >2013-12-04 08:51:50,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5148b02f >2013-12-04 08:51:50,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb5854f2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2be9c679}, log id: 5148b02f >2013-12-04 08:51:55,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e64db93 >2013-12-04 08:51:56,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6e64db93 >2013-12-04 08:51:56,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 16139299 >2013-12-04 08:51:56,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2720f212, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@940fc0d5}, log id: 16139299 >2013-12-04 08:52:01,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7595b9f3 >2013-12-04 08:52:02,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7595b9f3 >2013-12-04 08:52:02,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2bff6e2f >2013-12-04 08:52:02,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce5e5cb3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8c2c75d}, log id: 2bff6e2f >2013-12-04 08:52:07,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24ae4fff >2013-12-04 08:52:07,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 24ae4fff >2013-12-04 08:52:07,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ce9484f >2013-12-04 08:52:08,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@313a9ca4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c90a8d72}, log id: ce9484f >2013-12-04 08:52:13,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7f4feb55 >2013-12-04 08:52:13,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f4feb55 >2013-12-04 08:52:13,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6520ad21 >2013-12-04 08:52:13,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8460d4a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e5db798}, log id: 6520ad21 >2013-12-04 08:52:18,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26fd2b00 >2013-12-04 08:52:19,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 26fd2b00 >2013-12-04 08:52:19,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 717cb7cf >2013-12-04 08:52:19,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d96b4362, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@956f7647}, log id: 717cb7cf >2013-12-04 08:52:24,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5623034 >2013-12-04 08:52:25,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5623034 >2013-12-04 08:52:25,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4f4ae10c >2013-12-04 08:52:25,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@849d79d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31a2058}, log id: 4f4ae10c >2013-12-04 08:52:30,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 44e47275 >2013-12-04 08:52:31,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 44e47275 >2013-12-04 08:52:31,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4f47064e >2013-12-04 08:52:31,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4b029de, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7e67b96}, log id: 4f47064e >2013-12-04 08:52:36,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 28d1225f >2013-12-04 08:52:36,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 28d1225f >2013-12-04 08:52:36,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ee2b9f >2013-12-04 08:52:37,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbce3574, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81b52d8e}, log id: 7ee2b9f >2013-12-04 08:52:38,989 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-04 08:52:38,990 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:52:39,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6fe989cc >2013-12-04 08:52:39,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6fe989cc >2013-12-04 08:52:42,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f9906a3 >2013-12-04 08:52:42,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4f9906a3 >2013-12-04 08:52:42,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: cd6b443 >2013-12-04 08:52:43,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c15a4afd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b14b8bad}, log id: cd6b443 >2013-12-04 08:52:48,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7f1bff06 >2013-12-04 08:52:48,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f1bff06 >2013-12-04 08:52:48,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 180b7254 >2013-12-04 08:52:48,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef8ce94c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4de653a5}, log id: 180b7254 >2013-12-04 08:52:53,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2f8a56dc >2013-12-04 08:52:54,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2f8a56dc >2013-12-04 08:52:54,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 760ce763 >2013-12-04 08:52:54,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d3c058e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdafa0c4}, log id: 760ce763 >2013-12-04 08:52:59,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 25b228e >2013-12-04 08:53:00,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 25b228e >2013-12-04 08:53:00,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f76750c >2013-12-04 08:53:00,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10284348, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac7095e1}, log id: 1f76750c >2013-12-04 08:53:05,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70187f63 >2013-12-04 08:53:06,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 70187f63 >2013-12-04 08:53:06,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 22841fe3 >2013-12-04 08:53:06,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e02e5221, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fddab75}, log id: 22841fe3 >2013-12-04 08:53:11,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19a6f88d >2013-12-04 08:53:11,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 19a6f88d >2013-12-04 08:53:11,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 482329af >2013-12-04 08:53:12,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4045bda9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8ae9ac0}, log id: 482329af >2013-12-04 08:53:17,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2aed1d7c >2013-12-04 08:53:17,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2aed1d7c >2013-12-04 08:53:17,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 71fee015 >2013-12-04 08:53:18,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0a731d4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92cb9ed2}, log id: 71fee015 >2013-12-04 08:53:23,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 73fd8379 >2013-12-04 08:53:23,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 73fd8379 >2013-12-04 08:53:23,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: dddc326 >2013-12-04 08:53:23,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7331d856, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a11e3260}, log id: dddc326 >2013-12-04 08:53:28,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4d4581db >2013-12-04 08:53:29,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d4581db >2013-12-04 08:53:29,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 47cc65b >2013-12-04 08:53:29,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f150e22e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26ee3750}, log id: 47cc65b >2013-12-04 08:53:34,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 44286c7c >2013-12-04 08:53:35,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 44286c7c >2013-12-04 08:53:35,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 49e7dad9 >2013-12-04 08:53:35,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f28958e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ccff0f9}, log id: 49e7dad9 >2013-12-04 08:53:39,310 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-04 08:53:39,311 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:53:39,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 74291fd2 >2013-12-04 08:53:39,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 74291fd2 >2013-12-04 08:53:40,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c801ca7 >2013-12-04 08:53:41,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1c801ca7 >2013-12-04 08:53:41,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 135c89f2 >2013-12-04 08:53:41,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e6c4fce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a8c699d}, log id: 135c89f2 >2013-12-04 08:53:46,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35f8e9bf >2013-12-04 08:53:46,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 35f8e9bf >2013-12-04 08:53:46,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29b9bd9c >2013-12-04 08:53:47,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68bfd1c4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64dd1e4c}, log id: 29b9bd9c >2013-12-04 08:53:52,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5037fc89 >2013-12-04 08:53:52,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5037fc89 >2013-12-04 08:53:52,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2abc99cd >2013-12-04 08:53:53,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61bf442a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd096379}, log id: 2abc99cd >2013-12-04 08:53:58,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5307f92c >2013-12-04 08:53:58,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5307f92c >2013-12-04 08:53:58,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5fcc1de7 >2013-12-04 08:53:58,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcffadb7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8461cc2}, log id: 5fcc1de7 >2013-12-04 08:54:03,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 39cd158e >2013-12-04 08:54:04,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 39cd158e >2013-12-04 08:54:04,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 21516592 >2013-12-04 08:54:04,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23cbe960, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1857e236}, log id: 21516592 >2013-12-04 08:54:09,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 14e875e6 >2013-12-04 08:54:10,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 14e875e6 >2013-12-04 08:54:10,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 679b1a9d >2013-12-04 08:54:10,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@657097c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a29b2159}, log id: 679b1a9d >2013-12-04 08:54:15,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 753b3674 >2013-12-04 08:54:16,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 753b3674 >2013-12-04 08:54:16,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 69e75dae >2013-12-04 08:54:16,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b17e8b2d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c02395fb}, log id: 69e75dae >2013-12-04 08:54:21,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 406c115b >2013-12-04 08:54:21,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 406c115b >2013-12-04 08:54:21,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2f84c4aa >2013-12-04 08:54:22,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a03e77b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd416454}, log id: 2f84c4aa >2013-12-04 08:54:27,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 64d5fa9b >2013-12-04 08:54:27,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 64d5fa9b >2013-12-04 08:54:27,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 444d49a >2013-12-04 08:54:27,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6218104, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39fd6d9b}, log id: 444d49a >2013-12-04 08:54:29,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: e66d80b >2013-12-04 08:54:29,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2270cd60, log id: e66d80b >2013-12-04 08:54:29,308 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-97) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:54:29,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1bbb6b4a >2013-12-04 08:54:29,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6cc29c5d, log id: 1bbb6b4a >2013-12-04 08:54:33,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 733467af >2013-12-04 08:54:33,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 733467af >2013-12-04 08:54:33,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63b516f1 >2013-12-04 08:54:33,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@818abc71, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d89b704}, log id: 63b516f1 >2013-12-04 08:54:38,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2b52f4ea >2013-12-04 08:54:39,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b52f4ea >2013-12-04 08:54:39,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 201fcb58 >2013-12-04 08:54:39,605 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) [49a6fca1] No up server in cluster >2013-12-04 08:54:39,606 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) [49a6fca1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:54:39,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 39421c0d >2013-12-04 08:54:39,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6ee9fa1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bbda883}, log id: 201fcb58 >2013-12-04 08:54:39,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterTasksListVDSCommand, return: [], log id: 39421c0d >2013-12-04 08:54:44,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: b3adabf >2013-12-04 08:54:45,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: b3adabf >2013-12-04 08:54:45,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4c9fa31a >2013-12-04 08:54:45,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aec2bc34, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@634f81a1}, log id: 4c9fa31a >2013-12-04 08:54:50,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 61442c47 >2013-12-04 08:54:51,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 61442c47 >2013-12-04 08:54:51,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5f9b85ba >2013-12-04 08:54:51,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4dffdf80, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9cda005}, log id: 5f9b85ba >2013-12-04 08:54:56,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 718841bc >2013-12-04 08:54:56,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 718841bc >2013-12-04 08:54:56,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 54733925 >2013-12-04 08:54:57,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa2288eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d30a5686}, log id: 54733925 >2013-12-04 08:55:02,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 64ba44a5 >2013-12-04 08:55:02,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 64ba44a5 >2013-12-04 08:55:02,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6cf32fc6 >2013-12-04 08:55:03,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7774a0c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c771b905}, log id: 6cf32fc6 >2013-12-04 08:55:08,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36629c46 >2013-12-04 08:55:08,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 36629c46 >2013-12-04 08:55:08,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5997c70d >2013-12-04 08:55:08,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46ee7a64, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e70916c}, log id: 5997c70d >2013-12-04 08:55:13,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3beafd66 >2013-12-04 08:55:14,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3beafd66 >2013-12-04 08:55:14,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f2f3b14 >2013-12-04 08:55:14,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaf1468, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a21e4231}, log id: 5f2f3b14 >2013-12-04 08:55:19,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c7be8ca >2013-12-04 08:55:20,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2c7be8ca >2013-12-04 08:55:20,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ce1e129 >2013-12-04 08:55:20,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4def15e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec19454b}, log id: 3ce1e129 >2013-12-04 08:55:25,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 26a1fc31 >2013-12-04 08:55:26,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 26a1fc31 >2013-12-04 08:55:26,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 516b90ee >2013-12-04 08:55:26,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0f011fa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23155f44}, log id: 516b90ee >2013-12-04 08:55:31,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5eddebd3 >2013-12-04 08:55:31,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5eddebd3 >2013-12-04 08:55:31,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 120b4958 >2013-12-04 08:55:32,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16ab6e95, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69394e44}, log id: 120b4958 >2013-12-04 08:55:37,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c2b3a21 >2013-12-04 08:55:37,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6c2b3a21 >2013-12-04 08:55:37,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 37d8bb49 >2013-12-04 08:55:37,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed87ac33, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11813652}, log id: 37d8bb49 >2013-12-04 08:55:39,927 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-04 08:55:39,933 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:55:39,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3ccd711b >2013-12-04 08:55:40,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3ccd711b >2013-12-04 08:55:43,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20133586 >2013-12-04 08:55:43,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 20133586 >2013-12-04 08:55:43,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d9b97b4 >2013-12-04 08:55:43,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8c64c3e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52b7e45c}, log id: 3d9b97b4 >2013-12-04 08:55:48,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4741238c >2013-12-04 08:55:49,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4741238c >2013-12-04 08:55:49,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a76e507 >2013-12-04 08:55:49,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@880e0efc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb5eb08a}, log id: 4a76e507 >2013-12-04 08:55:54,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5161f3a6 >2013-12-04 08:55:55,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5161f3a6 >2013-12-04 08:55:55,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 421b8b8c >2013-12-04 08:55:55,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@707045e6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9a15ba1}, log id: 421b8b8c >2013-12-04 08:56:00,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39e30259 >2013-12-04 08:56:01,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 39e30259 >2013-12-04 08:56:01,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 136ccbd4 >2013-12-04 08:56:01,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44e37174, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85e63812}, log id: 136ccbd4 >2013-12-04 08:56:06,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4bcb63bc >2013-12-04 08:56:06,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4bcb63bc >2013-12-04 08:56:06,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 19b96492 >2013-12-04 08:56:07,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c5c8cf9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44bbfe40}, log id: 19b96492 >2013-12-04 08:56:12,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7b69130b >2013-12-04 08:56:12,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b69130b >2013-12-04 08:56:12,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3779d520 >2013-12-04 08:56:12,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d676e7fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc6e2f3e}, log id: 3779d520 >2013-12-04 08:56:17,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a5052d6 >2013-12-04 08:56:18,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5a5052d6 >2013-12-04 08:56:18,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 37ceb8b7 >2013-12-04 08:56:18,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5af8a8b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38e973f7}, log id: 37ceb8b7 >2013-12-04 08:56:23,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 65a548a5 >2013-12-04 08:56:24,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 65a548a5 >2013-12-04 08:56:24,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 51c66efa >2013-12-04 08:56:24,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc67291d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ba5e48b}, log id: 51c66efa >2013-12-04 08:56:29,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 12063401 >2013-12-04 08:56:30,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 12063401 >2013-12-04 08:56:30,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1f4a7bb2 >2013-12-04 08:56:30,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5617c6a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a26e0e83}, log id: 1f4a7bb2 >2013-12-04 08:56:35,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3991ba93 >2013-12-04 08:56:35,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3991ba93 >2013-12-04 08:56:35,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 21a43480 >2013-12-04 08:56:36,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@194526ae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b65f847}, log id: 21a43480 >2013-12-04 08:56:40,242 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-04 08:56:40,242 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:56:40,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 65371bf8 >2013-12-04 08:56:40,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 65371bf8 >2013-12-04 08:56:41,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4998445b >2013-12-04 08:56:41,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4998445b >2013-12-04 08:56:41,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 754f5c76 >2013-12-04 08:56:42,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24b8430d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36963e3e}, log id: 754f5c76 >2013-12-04 08:56:47,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3681ece8 >2013-12-04 08:56:47,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3681ece8 >2013-12-04 08:56:47,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 61058507 >2013-12-04 08:56:47,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fbf51e1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f35cdd16}, log id: 61058507 >2013-12-04 08:56:52,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: f1aa62e >2013-12-04 08:56:53,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: f1aa62e >2013-12-04 08:56:53,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7939fd86 >2013-12-04 08:56:53,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f1a4b43, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bcba397}, log id: 7939fd86 >2013-12-04 08:56:58,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1e86858a >2013-12-04 08:56:59,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e86858a >2013-12-04 08:56:59,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1d5e6f83 >2013-12-04 08:56:59,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41228f3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90ac15f7}, log id: 1d5e6f83 >2013-12-04 08:57:04,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3421e234 >2013-12-04 08:57:05,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3421e234 >2013-12-04 08:57:05,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2085fb8d >2013-12-04 08:57:05,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b979b70, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@413e3b0f}, log id: 2085fb8d >2013-12-04 08:57:10,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a81d372 >2013-12-04 08:57:10,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1a81d372 >2013-12-04 08:57:10,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54d8aec9 >2013-12-04 08:57:11,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d106a1fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a8ad9f7}, log id: 54d8aec9 >2013-12-04 08:57:16,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 31dd5ca9 >2013-12-04 08:57:16,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 31dd5ca9 >2013-12-04 08:57:16,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7c246b2c >2013-12-04 08:57:16,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c6168a6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70259dd2}, log id: 7c246b2c >2013-12-04 08:57:21,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6cdf8141 >2013-12-04 08:57:22,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6cdf8141 >2013-12-04 08:57:22,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: cd60756 >2013-12-04 08:57:22,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bdb6601, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e305ec80}, log id: cd60756 >2013-12-04 08:57:27,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 152b4c65 >2013-12-04 08:57:28,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 152b4c65 >2013-12-04 08:57:28,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 35740157 >2013-12-04 08:57:28,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13e6890, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@305290f0}, log id: 35740157 >2013-12-04 08:57:33,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 67f165f8 >2013-12-04 08:57:34,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 67f165f8 >2013-12-04 08:57:34,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 77446179 >2013-12-04 08:57:34,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@686177e7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ca10981}, log id: 77446179 >2013-12-04 08:57:39,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4842984e >2013-12-04 08:57:39,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4842984e >2013-12-04 08:57:39,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f521f4 >2013-12-04 08:57:40,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5de25af3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cffe2907}, log id: 7f521f4 >2013-12-04 08:57:40,568 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) [451f957d] No up server in cluster >2013-12-04 08:57:40,571 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) [451f957d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:57:40,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 474ee085 >2013-12-04 08:57:40,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 474ee085 >2013-12-04 08:57:45,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 17c675d0 >2013-12-04 08:57:45,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 17c675d0 >2013-12-04 08:57:45,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 57121346 >2013-12-04 08:57:46,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd6e79d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70f2abc7}, log id: 57121346 >2013-12-04 08:57:51,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6271f281 >2013-12-04 08:57:51,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6271f281 >2013-12-04 08:57:51,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e728027 >2013-12-04 08:57:52,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@347c1efd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf5d69b2}, log id: 6e728027 >2013-12-04 08:57:57,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7becfb59 >2013-12-04 08:57:57,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7becfb59 >2013-12-04 08:57:57,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57ebe16c >2013-12-04 08:57:57,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31c818c4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@813c4c71}, log id: 57ebe16c >2013-12-04 08:58:02,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 363526f >2013-12-04 08:58:03,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 363526f >2013-12-04 08:58:03,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 37104f37 >2013-12-04 08:58:03,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1415b5ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1c07495}, log id: 37104f37 >2013-12-04 08:58:08,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 15e4cd78 >2013-12-04 08:58:09,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 15e4cd78 >2013-12-04 08:58:09,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4bfd6b2 >2013-12-04 08:58:09,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52653ccf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1c55a70}, log id: 4bfd6b2 >2013-12-04 08:58:14,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b24764 >2013-12-04 08:58:15,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6b24764 >2013-12-04 08:58:15,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 37083782 >2013-12-04 08:58:15,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@553cc8e5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1682a5a}, log id: 37083782 >2013-12-04 08:58:20,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70567946 >2013-12-04 08:58:20,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 70567946 >2013-12-04 08:58:20,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 499ab6a9 >2013-12-04 08:58:21,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@370e5b68, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@948fb8e2}, log id: 499ab6a9 >2013-12-04 08:58:26,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a3c0fc8 >2013-12-04 08:58:26,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a3c0fc8 >2013-12-04 08:58:26,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 623298d4 >2013-12-04 08:58:27,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19d9cd13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@616c906c}, log id: 623298d4 >2013-12-04 08:58:32,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 419c85a4 >2013-12-04 08:58:32,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 419c85a4 >2013-12-04 08:58:32,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b7a7f70 >2013-12-04 08:58:32,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a36ee56, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d61b9c07}, log id: 7b7a7f70 >2013-12-04 08:58:37,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 25d9d4a2 >2013-12-04 08:58:38,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 25d9d4a2 >2013-12-04 08:58:38,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5bd0d362 >2013-12-04 08:58:38,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3ba44cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb9a3bc1}, log id: 5bd0d362 >2013-12-04 08:58:40,898 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) No up server in cluster >2013-12-04 08:58:40,911 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:58:40,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c5ed58d >2013-12-04 08:58:41,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5c5ed58d >2013-12-04 08:58:43,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a8e05de >2013-12-04 08:58:44,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6a8e05de >2013-12-04 08:58:44,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c495c9 >2013-12-04 08:58:44,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cc444bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52287880}, log id: c495c9 >2013-12-04 08:58:49,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 73cf0b55 >2013-12-04 08:58:50,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 73cf0b55 >2013-12-04 08:58:50,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4ce18a15 >2013-12-04 08:58:50,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3baf4fc3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebcc299a}, log id: 4ce18a15 >2013-12-04 08:58:55,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5e939143 >2013-12-04 08:58:55,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5e939143 >2013-12-04 08:58:55,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7dcb8c21 >2013-12-04 08:58:56,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae75175a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd5139c0}, log id: 7dcb8c21 >2013-12-04 08:59:01,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22cc6e7a >2013-12-04 08:59:01,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 22cc6e7a >2013-12-04 08:59:01,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67875314 >2013-12-04 08:59:01,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ed041cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb9de50d}, log id: 67875314 >2013-12-04 08:59:07,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c212161 >2013-12-04 08:59:07,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6c212161 >2013-12-04 08:59:07,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40bb39a9 >2013-12-04 08:59:07,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc4560db, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9071dc85}, log id: 40bb39a9 >2013-12-04 08:59:12,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 17fcc007 >2013-12-04 08:59:13,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 17fcc007 >2013-12-04 08:59:13,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a738105 >2013-12-04 08:59:13,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8215d66c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb36b773}, log id: 5a738105 >2013-12-04 08:59:18,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 317c449c >2013-12-04 08:59:19,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 317c449c >2013-12-04 08:59:19,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 380732e2 >2013-12-04 08:59:19,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea19404c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ec03abd}, log id: 380732e2 >2013-12-04 08:59:24,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: d057a84 >2013-12-04 08:59:25,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: d057a84 >2013-12-04 08:59:25,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4822a8f4 >2013-12-04 08:59:25,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@577c99bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7486400}, log id: 4822a8f4 >2013-12-04 08:59:29,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2488eea2 >2013-12-04 08:59:29,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3897ebd6, log id: 2488eea2 >2013-12-04 08:59:29,932 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-74) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:59:29,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7dfc4ba0 >2013-12-04 08:59:30,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@62bce462, log id: 7dfc4ba0 >2013-12-04 08:59:30,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 343b91e3 >2013-12-04 08:59:30,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 343b91e3 >2013-12-04 08:59:30,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2c9bf88a >2013-12-04 08:59:31,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43dd61c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b96d5cb}, log id: 2c9bf88a >2013-12-04 08:59:36,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36d8ece2 >2013-12-04 08:59:36,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 36d8ece2 >2013-12-04 08:59:36,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 15db2940 >2013-12-04 08:59:36,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f358efd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa2ff0ee}, log id: 15db2940 >2013-12-04 08:59:41,228 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) [1f01d1f] No up server in cluster >2013-12-04 08:59:41,237 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) [1f01d1f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 08:59:41,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 33214135 >2013-12-04 08:59:41,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterTasksListVDSCommand, return: [], log id: 33214135 >2013-12-04 08:59:41,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55a9c83b >2013-12-04 08:59:42,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 55a9c83b >2013-12-04 08:59:42,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45cc4934 >2013-12-04 08:59:42,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@676e3601, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83603bb0}, log id: 45cc4934 >2013-12-04 08:59:47,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f0901ef >2013-12-04 08:59:48,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7f0901ef >2013-12-04 08:59:48,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5d851bf2 >2013-12-04 08:59:48,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@211d5926, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2f1d13f}, log id: 5d851bf2 >2013-12-04 08:59:53,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 121a25d4 >2013-12-04 08:59:54,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 121a25d4 >2013-12-04 08:59:54,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 75ef40d1 >2013-12-04 08:59:54,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c38b8757, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a49cf75}, log id: 75ef40d1 >2013-12-04 08:59:59,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e1fc669 >2013-12-04 08:59:59,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e1fc669 >2013-12-04 08:59:59,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 324fc5b >2013-12-04 09:00:00,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fcef137, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b02f9d9c}, log id: 324fc5b >2013-12-04 09:00:05,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3873bc8f >2013-12-04 09:00:05,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3873bc8f >2013-12-04 09:00:05,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4fa346e0 >2013-12-04 09:00:05,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1815baba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ab54b2f}, log id: 4fa346e0 >2013-12-04 09:00:11,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f573795 >2013-12-04 09:00:11,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3f573795 >2013-12-04 09:00:11,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 60410a99 >2013-12-04 09:00:11,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@499e7ec0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2844103}, log id: 60410a99 >2013-12-04 09:00:16,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45acbd66 >2013-12-04 09:00:17,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 45acbd66 >2013-12-04 09:00:17,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2be6a4be >2013-12-04 09:00:17,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67169db8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d96d6d15}, log id: 2be6a4be >2013-12-04 09:00:22,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 10325fdf >2013-12-04 09:00:23,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 10325fdf >2013-12-04 09:00:23,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54a53353 >2013-12-04 09:00:23,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d0f46ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e84aa97}, log id: 54a53353 >2013-12-04 09:00:28,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 34cc85d6 >2013-12-04 09:00:29,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 34cc85d6 >2013-12-04 09:00:29,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 64244932 >2013-12-04 09:00:29,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@deaf70f1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cedd21f6}, log id: 64244932 >2013-12-04 09:00:34,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1cede1a0 >2013-12-04 09:00:34,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1cede1a0 >2013-12-04 09:00:34,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d065944 >2013-12-04 09:00:35,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2970867e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65f88d26}, log id: 3d065944 >2013-12-04 09:00:40,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5cbc9456 >2013-12-04 09:00:40,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5cbc9456 >2013-12-04 09:00:40,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c25f365 >2013-12-04 09:00:40,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39c39b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee71c0c6}, log id: c25f365 >2013-12-04 09:00:41,545 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) No up server in cluster >2013-12-04 09:00:41,549 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:00:41,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 48e9ca7 >2013-12-04 09:00:41,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterTasksListVDSCommand, return: [], log id: 48e9ca7 >2013-12-04 09:00:45,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ee9f908 >2013-12-04 09:00:46,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6ee9f908 >2013-12-04 09:00:46,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3128c0a3 >2013-12-04 09:00:46,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69e372da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e214dcd}, log id: 3128c0a3 >2013-12-04 09:00:51,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 48781db2 >2013-12-04 09:00:52,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 48781db2 >2013-12-04 09:00:52,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 755a8abe >2013-12-04 09:00:52,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b06fdedb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc056f85}, log id: 755a8abe >2013-12-04 09:00:57,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 23741227 >2013-12-04 09:00:58,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 23741227 >2013-12-04 09:00:58,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 56ad496d >2013-12-04 09:00:58,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d02f464, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa65b56e}, log id: 56ad496d >2013-12-04 09:01:03,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1949eb05 >2013-12-04 09:01:03,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1949eb05 >2013-12-04 09:01:03,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42ff8668 >2013-12-04 09:01:04,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf4957ce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@226ef18d}, log id: 42ff8668 >2013-12-04 09:01:09,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7823a8b2 >2013-12-04 09:01:09,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7823a8b2 >2013-12-04 09:01:09,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7b56e3c >2013-12-04 09:01:10,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc4da723, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1db12e47}, log id: 7b56e3c >2013-12-04 09:01:15,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 48d2a4c7 >2013-12-04 09:01:15,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 48d2a4c7 >2013-12-04 09:01:15,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 638eae9d >2013-12-04 09:01:15,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22bab770, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@801ed6d0}, log id: 638eae9d >2013-12-04 09:01:20,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 32b23311 >2013-12-04 09:01:21,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 32b23311 >2013-12-04 09:01:21,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4207268b >2013-12-04 09:01:21,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bbb65d1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2d59b91}, log id: 4207268b >2013-12-04 09:01:26,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5813b1a2 >2013-12-04 09:01:27,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5813b1a2 >2013-12-04 09:01:27,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4c3ee67e >2013-12-04 09:01:27,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32b97214, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@836031b0}, log id: 4c3ee67e >2013-12-04 09:01:32,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 26aec572 >2013-12-04 09:01:33,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 26aec572 >2013-12-04 09:01:33,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1f7837cb >2013-12-04 09:01:33,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@deda2b1f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfb39506}, log id: 1f7837cb >2013-12-04 09:01:38,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 588a856c >2013-12-04 09:01:38,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 588a856c >2013-12-04 09:01:38,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 75a23dff >2013-12-04 09:01:39,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3af8fd80, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccdba096}, log id: 75a23dff >2013-12-04 09:01:41,864 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-04 09:01:41,868 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:01:41,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6dab9837 >2013-12-04 09:01:42,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6dab9837 >2013-12-04 09:01:44,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42fd7aec >2013-12-04 09:01:44,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 42fd7aec >2013-12-04 09:01:44,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63fa7424 >2013-12-04 09:01:45,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16188bc3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3812299}, log id: 63fa7424 >2013-12-04 09:01:50,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 632ad0fe >2013-12-04 09:01:50,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 632ad0fe >2013-12-04 09:01:50,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 701fad70 >2013-12-04 09:01:51,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52262577, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ac1c50}, log id: 701fad70 >2013-12-04 09:01:56,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1442ea8c >2013-12-04 09:01:56,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1442ea8c >2013-12-04 09:01:56,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50b570a7 >2013-12-04 09:01:56,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcf357e1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0bdd904}, log id: 50b570a7 >2013-12-04 09:02:01,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b78def >2013-12-04 09:02:02,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1b78def >2013-12-04 09:02:02,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d6f92f >2013-12-04 09:02:02,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d9747, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43258933}, log id: 2d6f92f >2013-12-04 09:02:07,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 58ee2a98 >2013-12-04 09:02:08,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 58ee2a98 >2013-12-04 09:02:08,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 63fb4a38 >2013-12-04 09:02:08,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff79d919, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91e685d7}, log id: 63fb4a38 >2013-12-04 09:02:13,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 828bf49 >2013-12-04 09:02:13,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 828bf49 >2013-12-04 09:02:13,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5b775eb4 >2013-12-04 09:02:14,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85cf757, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@662553cd}, log id: 5b775eb4 >2013-12-04 09:02:19,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 66f6b821 >2013-12-04 09:02:19,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 66f6b821 >2013-12-04 09:02:19,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 472c8757 >2013-12-04 09:02:20,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7622948, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab432e1c}, log id: 472c8757 >2013-12-04 09:02:25,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5229cbf5 >2013-12-04 09:02:25,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5229cbf5 >2013-12-04 09:02:25,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1657b1db >2013-12-04 09:02:25,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93e1b8f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a4e35c8}, log id: 1657b1db >2013-12-04 09:02:30,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 92959d2 >2013-12-04 09:02:31,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 92959d2 >2013-12-04 09:02:31,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 51c07c25 >2013-12-04 09:02:31,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd07ec66, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b57d46cd}, log id: 51c07c25 >2013-12-04 09:02:36,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ad887a6 >2013-12-04 09:02:37,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1ad887a6 >2013-12-04 09:02:37,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7da2df9e >2013-12-04 09:02:37,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9113ff96, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b27e9afd}, log id: 7da2df9e >2013-12-04 09:02:42,197 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-04 09:02:42,200 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:02:42,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 78eff130 >2013-12-04 09:02:42,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: 78eff130 >2013-12-04 09:02:42,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 764a343a >2013-12-04 09:02:43,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 764a343a >2013-12-04 09:02:43,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4951ce61 >2013-12-04 09:02:43,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7489024, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dafcf95}, log id: 4951ce61 >2013-12-04 09:02:48,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5db0f618 >2013-12-04 09:02:48,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5db0f618 >2013-12-04 09:02:48,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 93d0b82 >2013-12-04 09:02:49,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc8d5863, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7a96ae2}, log id: 93d0b82 >2013-12-04 09:02:54,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5feb7dcb >2013-12-04 09:02:54,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5feb7dcb >2013-12-04 09:02:54,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3482e762 >2013-12-04 09:02:55,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b49a6bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@268b7b9b}, log id: 3482e762 >2013-12-04 09:03:00,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37157628 >2013-12-04 09:03:00,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 37157628 >2013-12-04 09:03:00,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b74b586 >2013-12-04 09:03:00,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70b545e6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@458e00f7}, log id: 3b74b586 >2013-12-04 09:03:05,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 16e1c9ea >2013-12-04 09:03:06,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 16e1c9ea >2013-12-04 09:03:06,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 11a9b18e >2013-12-04 09:03:06,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9047419e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b26f4254}, log id: 11a9b18e >2013-12-04 09:03:11,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 43248b84 >2013-12-04 09:03:12,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 43248b84 >2013-12-04 09:03:12,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1c0901b1 >2013-12-04 09:03:12,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fceab45, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c31c44c1}, log id: 1c0901b1 >2013-12-04 09:03:17,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66b989c8 >2013-12-04 09:03:17,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 66b989c8 >2013-12-04 09:03:17,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 148a7c92 >2013-12-04 09:03:18,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@242fade6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89112fbc}, log id: 148a7c92 >2013-12-04 09:03:23,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4260b493 >2013-12-04 09:03:23,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4260b493 >2013-12-04 09:03:23,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3553acdd >2013-12-04 09:03:24,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@826a75c8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75e3ebed}, log id: 3553acdd >2013-12-04 09:03:29,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 37e9c5dc >2013-12-04 09:03:29,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 37e9c5dc >2013-12-04 09:03:29,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 13f570cf >2013-12-04 09:03:29,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f656b6ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97946df8}, log id: 13f570cf >2013-12-04 09:03:34,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b4ab743 >2013-12-04 09:03:35,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1b4ab743 >2013-12-04 09:03:35,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 615fc64b >2013-12-04 09:03:35,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23f7b26c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e265cf79}, log id: 615fc64b >2013-12-04 09:03:40,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 724139b7 >2013-12-04 09:03:41,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 724139b7 >2013-12-04 09:03:41,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53908400 >2013-12-04 09:03:41,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b4856eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea19c258}, log id: 53908400 >2013-12-04 09:03:42,510 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-04 09:03:42,515 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:03:42,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1e85b0d1 >2013-12-04 09:03:42,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1e85b0d1 >2013-12-04 09:03:46,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1dd39396 >2013-12-04 09:03:46,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dd39396 >2013-12-04 09:03:46,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 480b470b >2013-12-04 09:03:47,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7467d544, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4529f9b1}, log id: 480b470b >2013-12-04 09:03:52,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: b35595c >2013-12-04 09:03:52,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: b35595c >2013-12-04 09:03:52,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7196464c >2013-12-04 09:03:53,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2972e089, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d685eb8}, log id: 7196464c >2013-12-04 09:03:58,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20d29e83 >2013-12-04 09:03:58,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 20d29e83 >2013-12-04 09:03:58,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 52ef8bf2 >2013-12-04 09:03:58,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c278cf3f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c52eb84f}, log id: 52ef8bf2 >2013-12-04 09:04:03,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 65b832bc >2013-12-04 09:04:04,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 65b832bc >2013-12-04 09:04:04,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 517d47cf >2013-12-04 09:04:04,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5bc9477, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb182dfd}, log id: 517d47cf >2013-12-04 09:04:09,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2aba3809 >2013-12-04 09:04:10,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2aba3809 >2013-12-04 09:04:10,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2f0a3799 >2013-12-04 09:04:10,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aae822ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13eb7657}, log id: 2f0a3799 >2013-12-04 09:04:15,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 671ba289 >2013-12-04 09:04:16,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 671ba289 >2013-12-04 09:04:16,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79078551 >2013-12-04 09:04:16,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fdf9819, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f735b4b4}, log id: 79078551 >2013-12-04 09:04:21,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a4b7b19 >2013-12-04 09:04:21,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4a4b7b19 >2013-12-04 09:04:21,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 8b589f0 >2013-12-04 09:04:22,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bce8195, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e9ff8bc}, log id: 8b589f0 >2013-12-04 09:04:27,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 686751dc >2013-12-04 09:04:27,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 686751dc >2013-12-04 09:04:27,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 63f45cf5 >2013-12-04 09:04:28,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d8a4208, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f905e58}, log id: 63f45cf5 >2013-12-04 09:04:30,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 117ab4e1 >2013-12-04 09:04:30,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3fdab62, log id: 117ab4e1 >2013-12-04 09:04:30,541 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-22) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:04:30,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2feb0fa >2013-12-04 09:04:30,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@72e92824, log id: 2feb0fa >2013-12-04 09:04:33,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 747bdedf >2013-12-04 09:04:33,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 747bdedf >2013-12-04 09:04:33,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 594aa2f1 >2013-12-04 09:04:33,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42d28b10, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bba6812}, log id: 594aa2f1 >2013-12-04 09:04:38,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73c733f7 >2013-12-04 09:04:39,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 73c733f7 >2013-12-04 09:04:39,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2a03ff65 >2013-12-04 09:04:39,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58c580ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87513d74}, log id: 2a03ff65 >2013-12-04 09:04:42,829 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) No up server in cluster >2013-12-04 09:04:42,837 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:04:42,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 83317e1 >2013-12-04 09:04:43,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterTasksListVDSCommand, return: [], log id: 83317e1 >2013-12-04 09:04:44,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 88c0f2c >2013-12-04 09:04:45,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 88c0f2c >2013-12-04 09:04:45,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19f29ce3 >2013-12-04 09:04:45,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d936271a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bc0b78d}, log id: 19f29ce3 >2013-12-04 09:04:50,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 29dc4941 >2013-12-04 09:04:51,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 29dc4941 >2013-12-04 09:04:51,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 710777e1 >2013-12-04 09:04:51,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59bf6a4f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba85de80}, log id: 710777e1 >2013-12-04 09:04:56,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 9602c37 >2013-12-04 09:04:56,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 9602c37 >2013-12-04 09:04:56,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1c9f17cc >2013-12-04 09:04:57,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f97303ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@328b4}, log id: 1c9f17cc >2013-12-04 09:05:02,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b8c6c16 >2013-12-04 09:05:02,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1b8c6c16 >2013-12-04 09:05:02,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 121bd68e >2013-12-04 09:05:02,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14f67520, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2122e3db}, log id: 121bd68e >2013-12-04 09:05:07,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 91658c5 >2013-12-04 09:05:08,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 91658c5 >2013-12-04 09:05:08,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 417a3296 >2013-12-04 09:05:08,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3608d35e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35a03af0}, log id: 417a3296 >2013-12-04 09:05:13,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 54222f36 >2013-12-04 09:05:14,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 54222f36 >2013-12-04 09:05:14,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1afc9ab0 >2013-12-04 09:05:14,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35afea4c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3b78209}, log id: 1afc9ab0 >2013-12-04 09:05:19,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 66c082bf >2013-12-04 09:05:19,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 66c082bf >2013-12-04 09:05:19,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 457687bd >2013-12-04 09:05:20,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13afd9cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51e91e9}, log id: 457687bd >2013-12-04 09:05:25,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 538e17cc >2013-12-04 09:05:25,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 538e17cc >2013-12-04 09:05:25,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2a0481f1 >2013-12-04 09:05:26,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f459a0f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7351df69}, log id: 2a0481f1 >2013-12-04 09:05:31,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 41dff81c >2013-12-04 09:05:31,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 41dff81c >2013-12-04 09:05:31,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1af3c49a >2013-12-04 09:05:31,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f646ceb9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93faf5d2}, log id: 1af3c49a >2013-12-04 09:05:36,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6adc37d2 >2013-12-04 09:05:37,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6adc37d2 >2013-12-04 09:05:37,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3a3ee1be >2013-12-04 09:05:37,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe41e685, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@918f0a38}, log id: 3a3ee1be >2013-12-04 09:05:42,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5cf2181c >2013-12-04 09:05:43,174 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-04 09:05:43,178 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:05:43,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24dfcac7 >2013-12-04 09:05:43,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5cf2181c >2013-12-04 09:05:43,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1459099b >2013-12-04 09:05:43,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 24dfcac7 >2013-12-04 09:05:43,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1af905, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a95bbf10}, log id: 1459099b >2013-12-04 09:05:48,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56a13595 >2013-12-04 09:05:49,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 56a13595 >2013-12-04 09:05:49,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7835c535 >2013-12-04 09:05:49,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90c0b252, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0df2b05}, log id: 7835c535 >2013-12-04 09:05:54,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f454021 >2013-12-04 09:05:54,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1f454021 >2013-12-04 09:05:54,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6370a490 >2013-12-04 09:05:55,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96f725ae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb68380e}, log id: 6370a490 >2013-12-04 09:06:00,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f3e9973 >2013-12-04 09:06:00,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5f3e9973 >2013-12-04 09:06:00,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7deec22c >2013-12-04 09:06:00,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@639ffbdb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ecd681f4}, log id: 7deec22c >2013-12-04 09:06:05,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2b5ae186 >2013-12-04 09:06:06,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b5ae186 >2013-12-04 09:06:06,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1dea1adc >2013-12-04 09:06:06,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60c4863f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abcbb5db}, log id: 1dea1adc >2013-12-04 09:06:11,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a45097d >2013-12-04 09:06:12,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3a45097d >2013-12-04 09:06:12,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5cb43ea6 >2013-12-04 09:06:12,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@875d5d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62319af5}, log id: 5cb43ea6 >2013-12-04 09:06:17,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14307d4c >2013-12-04 09:06:18,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 14307d4c >2013-12-04 09:06:18,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 72ae01ec >2013-12-04 09:06:18,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c6292e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74691d1f}, log id: 72ae01ec >2013-12-04 09:06:23,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6fc60f02 >2013-12-04 09:06:23,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6fc60f02 >2013-12-04 09:06:23,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6a00c5da >2013-12-04 09:06:24,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b956d295, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@110b74d2}, log id: 6a00c5da >2013-12-04 09:06:29,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3816a2cd >2013-12-04 09:06:29,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3816a2cd >2013-12-04 09:06:29,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 54b50f92 >2013-12-04 09:06:29,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53c69506, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c751bf47}, log id: 54b50f92 >2013-12-04 09:06:34,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b56f098 >2013-12-04 09:06:35,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1b56f098 >2013-12-04 09:06:35,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 647acb32 >2013-12-04 09:06:35,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82f23bc2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8749d136}, log id: 647acb32 >2013-12-04 09:06:40,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 69870974 >2013-12-04 09:06:41,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 69870974 >2013-12-04 09:06:41,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 682fcd85 >2013-12-04 09:06:41,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8025f3e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1008477}, log id: 682fcd85 >2013-12-04 09:06:43,476 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) No up server in cluster >2013-12-04 09:06:43,477 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:06:43,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 65782792 >2013-12-04 09:06:43,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterTasksListVDSCommand, return: [], log id: 65782792 >2013-12-04 09:06:46,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: bda4b35 >2013-12-04 09:06:47,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: bda4b35 >2013-12-04 09:06:47,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 745805a5 >2013-12-04 09:06:47,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2db7908, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d1a9ff}, log id: 745805a5 >2013-12-04 09:06:52,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: c7edf75 >2013-12-04 09:06:52,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: c7edf75 >2013-12-04 09:06:52,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5505c932 >2013-12-04 09:06:53,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d28ed0ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f543119b}, log id: 5505c932 >2013-12-04 09:06:58,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4da0ffb >2013-12-04 09:06:58,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4da0ffb >2013-12-04 09:06:58,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28049816 >2013-12-04 09:06:58,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@960c9685, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d09a6d3}, log id: 28049816 >2013-12-04 09:07:03,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 143ddc76 >2013-12-04 09:07:04,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 143ddc76 >2013-12-04 09:07:04,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11657dea >2013-12-04 09:07:04,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87912d0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40d14fbf}, log id: 11657dea >2013-12-04 09:07:09,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 827a216 >2013-12-04 09:07:10,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 827a216 >2013-12-04 09:07:10,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 460f9315 >2013-12-04 09:07:10,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aecee425, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54cfdfa0}, log id: 460f9315 >2013-12-04 09:07:15,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5fd8af2c >2013-12-04 09:07:16,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5fd8af2c >2013-12-04 09:07:16,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 77ac50c4 >2013-12-04 09:07:16,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24de7b2e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce2cd6be}, log id: 77ac50c4 >2013-12-04 09:07:21,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 763ca6d6 >2013-12-04 09:07:21,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 763ca6d6 >2013-12-04 09:07:21,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2fe36caf >2013-12-04 09:07:22,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b39ccbd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6d09c64}, log id: 2fe36caf >2013-12-04 09:07:27,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 34dda8a5 >2013-12-04 09:07:27,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 34dda8a5 >2013-12-04 09:07:27,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5c79ff26 >2013-12-04 09:07:28,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4ead61d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5487494c}, log id: 5c79ff26 >2013-12-04 09:07:33,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 492859f8 >2013-12-04 09:07:33,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 492859f8 >2013-12-04 09:07:33,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 776d092e >2013-12-04 09:07:33,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a40cb8c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b75a338}, log id: 776d092e >2013-12-04 09:07:38,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2fc72dc6 >2013-12-04 09:07:39,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fc72dc6 >2013-12-04 09:07:39,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7d972581 >2013-12-04 09:07:39,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@800bcbf2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12bf678d}, log id: 7d972581 >2013-12-04 09:07:43,785 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-04 09:07:43,797 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:07:43,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 16f7d9b9 >2013-12-04 09:07:44,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 16f7d9b9 >2013-12-04 09:07:44,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5efae84e >2013-12-04 09:07:45,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5efae84e >2013-12-04 09:07:45,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 12b32c68 >2013-12-04 09:07:45,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df608c00, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54fab9c6}, log id: 12b32c68 >2013-12-04 09:07:50,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10ff3b17 >2013-12-04 09:07:50,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 10ff3b17 >2013-12-04 09:07:50,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1656c17e >2013-12-04 09:07:51,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@680c8fa8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcaee238}, log id: 1656c17e >2013-12-04 09:07:56,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 32cc7e6c >2013-12-04 09:07:56,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 32cc7e6c >2013-12-04 09:07:56,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 287d5cf5 >2013-12-04 09:07:57,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2516658e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@674a326c}, log id: 287d5cf5 >2013-12-04 09:08:02,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f3a6e5 >2013-12-04 09:08:02,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7f3a6e5 >2013-12-04 09:08:02,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2eb7b30e >2013-12-04 09:08:02,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dfb7383, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f8ab7a6}, log id: 2eb7b30e >2013-12-04 09:08:07,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f8c269a >2013-12-04 09:08:08,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5f8c269a >2013-12-04 09:08:08,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15223a19 >2013-12-04 09:08:08,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cca405b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b213b826}, log id: 15223a19 >2013-12-04 09:08:13,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d487faf >2013-12-04 09:08:14,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: d487faf >2013-12-04 09:08:14,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3073add7 >2013-12-04 09:08:14,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ba1e709, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44c67746}, log id: 3073add7 >2013-12-04 09:08:19,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 642d3caa >2013-12-04 09:08:20,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 642d3caa >2013-12-04 09:08:20,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41de163b >2013-12-04 09:08:20,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1e3f2ad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a62cf73b}, log id: 41de163b >2013-12-04 09:08:25,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ae8c860 >2013-12-04 09:08:25,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: ae8c860 >2013-12-04 09:08:25,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4dd9c078 >2013-12-04 09:08:26,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20868f15, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e6bcaf3}, log id: 4dd9c078 >2013-12-04 09:08:31,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12f700b7 >2013-12-04 09:08:31,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 12f700b7 >2013-12-04 09:08:31,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 28ec3e11 >2013-12-04 09:08:31,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@896d0940, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad987f3a}, log id: 28ec3e11 >2013-12-04 09:08:37,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b720361 >2013-12-04 09:08:37,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6b720361 >2013-12-04 09:08:37,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 335c5513 >2013-12-04 09:08:37,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a6d83d4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15bfa1b6}, log id: 335c5513 >2013-12-04 09:08:38,809 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-12) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-04 09:08:38,874 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-5) [5e9e4f95] Running command: LogoutUserCommand internal: false. >2013-12-04 09:08:39,022 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [5e9e4f95] Correlation ID: 5e9e4f95, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2013-12-04 09:08:42,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71bf56ac >2013-12-04 09:08:43,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 71bf56ac >2013-12-04 09:08:43,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5d81e348 >2013-12-04 09:08:43,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3eae2b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a7d1c9b}, log id: 5d81e348 >2013-12-04 09:08:44,106 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) No up server in cluster >2013-12-04 09:08:44,109 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:08:44,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42d92347 >2013-12-04 09:08:44,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterTasksListVDSCommand, return: [], log id: 42d92347 >2013-12-04 09:08:48,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 13dfe7a8 >2013-12-04 09:08:49,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 13dfe7a8 >2013-12-04 09:08:49,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6948f69e >2013-12-04 09:08:49,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@254f86e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e6217a5}, log id: 6948f69e >2013-12-04 09:08:54,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3596d3b8 >2013-12-04 09:08:54,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3596d3b8 >2013-12-04 09:08:54,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 685f67 >2013-12-04 09:08:55,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d87f41, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d494733}, log id: 685f67 >2013-12-04 09:09:00,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a9fe147 >2013-12-04 09:09:00,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a9fe147 >2013-12-04 09:09:00,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b2ab074 >2013-12-04 09:09:01,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9f29903, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34172970}, log id: 2b2ab074 >2013-12-04 09:09:06,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6a9f5ad >2013-12-04 09:09:06,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a9f5ad >2013-12-04 09:09:06,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 58d80e90 >2013-12-04 09:09:06,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8d44acd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b8644bf}, log id: 58d80e90 >2013-12-04 09:09:11,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 700a8e9d >2013-12-04 09:09:12,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 700a8e9d >2013-12-04 09:09:12,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 523ca206 >2013-12-04 09:09:12,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@632c2eab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bde33e5b}, log id: 523ca206 >2013-12-04 09:09:17,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 42558c5f >2013-12-04 09:09:18,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 42558c5f >2013-12-04 09:09:18,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 67695293 >2013-12-04 09:09:18,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7000244d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f74baabd}, log id: 67695293 >2013-12-04 09:09:23,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55efbff1 >2013-12-04 09:09:24,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 55efbff1 >2013-12-04 09:09:24,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b5c05fd >2013-12-04 09:09:24,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb48616e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b09cd634}, log id: 4b5c05fd >2013-12-04 09:09:29,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 42ecccaf >2013-12-04 09:09:30,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 42ecccaf >2013-12-04 09:09:30,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 35c05b2 >2013-12-04 09:09:30,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e380236, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4af17500}, log id: 35c05b2 >2013-12-04 09:09:30,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 73b1564a >2013-12-04 09:09:31,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6e89dd2b, log id: 73b1564a >2013-12-04 09:09:31,124 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-45) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:09:31,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d176abf >2013-12-04 09:09:31,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@23a9085d, log id: 1d176abf >2013-12-04 09:09:35,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 47b2aa57 >2013-12-04 09:09:35,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 47b2aa57 >2013-12-04 09:09:35,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2af165be >2013-12-04 09:09:36,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b8ed17a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fbd4b9}, log id: 2af165be >2013-12-04 09:09:41,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 711798ec >2013-12-04 09:09:41,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 711798ec >2013-12-04 09:09:41,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27f221f7 >2013-12-04 09:09:42,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cd5eec9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9f043b3}, log id: 27f221f7 >2013-12-04 09:09:44,414 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) No up server in cluster >2013-12-04 09:09:44,419 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:09:44,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d5a304 >2013-12-04 09:09:44,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1d5a304 >2013-12-04 09:09:47,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 64b743c3 >2013-12-04 09:09:47,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 64b743c3 >2013-12-04 09:09:47,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45dded9b >2013-12-04 09:09:47,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8a52d1b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c472b76}, log id: 45dded9b >2013-12-04 09:09:52,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 215f8912 >2013-12-04 09:09:53,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 215f8912 >2013-12-04 09:09:53,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4ba62d93 >2013-12-04 09:09:53,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e45c8292, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4402a527}, log id: 4ba62d93 >2013-12-04 09:09:58,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 361cb6a6 >2013-12-04 09:09:59,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 361cb6a6 >2013-12-04 09:09:59,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: a009c62 >2013-12-04 09:09:59,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a487fb2c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68e0b9fc}, log id: a009c62 >2013-12-04 09:10:04,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 743c6d16 >2013-12-04 09:10:05,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 743c6d16 >2013-12-04 09:10:05,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5daab4c8 >2013-12-04 09:10:05,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b173872, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb49fe31}, log id: 5daab4c8 >2013-12-04 09:10:10,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14720af1 >2013-12-04 09:10:10,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 14720af1 >2013-12-04 09:10:10,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37cf77bd >2013-12-04 09:10:11,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9659337f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c429de6c}, log id: 37cf77bd >2013-12-04 09:10:16,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1260b09f >2013-12-04 09:10:16,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1260b09f >2013-12-04 09:10:16,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1bde8a0f >2013-12-04 09:10:16,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2a0f195, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c2a470a}, log id: 1bde8a0f >2013-12-04 09:10:21,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 31207d4e >2013-12-04 09:10:22,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 31207d4e >2013-12-04 09:10:22,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ba7cdc3 >2013-12-04 09:10:22,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed55901f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d4ccd07}, log id: 7ba7cdc3 >2013-12-04 09:10:27,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 300ff4d1 >2013-12-04 09:10:28,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 300ff4d1 >2013-12-04 09:10:28,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50623cea >2013-12-04 09:10:28,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f16eb22, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58d9d2f}, log id: 50623cea >2013-12-04 09:10:33,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5987be99 >2013-12-04 09:10:34,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5987be99 >2013-12-04 09:10:34,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20ae7d7d >2013-12-04 09:10:34,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63cfae5b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@955fa4a}, log id: 20ae7d7d >2013-12-04 09:10:39,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1036087d >2013-12-04 09:10:39,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1036087d >2013-12-04 09:10:39,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 39e7e308 >2013-12-04 09:10:40,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ef31c24, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c05f8cb}, log id: 39e7e308 >2013-12-04 09:10:44,733 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) [7973d44b] No up server in cluster >2013-12-04 09:10:44,742 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) [7973d44b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:10:44,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c452ad5 >2013-12-04 09:10:45,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1c452ad5 >2013-12-04 09:10:45,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 746db34 >2013-12-04 09:10:45,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 746db34 >2013-12-04 09:10:45,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e2e86e8 >2013-12-04 09:10:46,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2932f5a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f146aef}, log id: 5e2e86e8 >2013-12-04 09:10:51,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4cae956a >2013-12-04 09:10:51,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4cae956a >2013-12-04 09:10:51,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 107b1461 >2013-12-04 09:10:51,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a4dbb29, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@853943f5}, log id: 107b1461 >2013-12-04 09:10:56,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3461fe6e >2013-12-04 09:10:57,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3461fe6e >2013-12-04 09:10:57,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 434c75d1 >2013-12-04 09:10:57,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@449a0063, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c504711b}, log id: 434c75d1 >2013-12-04 09:11:02,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 552a5d4f >2013-12-04 09:11:03,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 552a5d4f >2013-12-04 09:11:03,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 19559dd5 >2013-12-04 09:11:03,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8648ef02, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c7a495c}, log id: 19559dd5 >2013-12-04 09:11:08,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1defef39 >2013-12-04 09:11:09,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1defef39 >2013-12-04 09:11:09,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6f18e75d >2013-12-04 09:11:09,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73ac2cf1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26cb4010}, log id: 6f18e75d >2013-12-04 09:11:14,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e3b777f >2013-12-04 09:11:14,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4e3b777f >2013-12-04 09:11:14,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f8c6f70 >2013-12-04 09:11:15,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e156ab94, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a511c36}, log id: 6f8c6f70 >2013-12-04 09:11:20,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5c7f192a >2013-12-04 09:11:20,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c7f192a >2013-12-04 09:11:20,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5bbc5689 >2013-12-04 09:11:21,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5d02487, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a400517a}, log id: 5bbc5689 >2013-12-04 09:11:26,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38c9bf62 >2013-12-04 09:11:26,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 38c9bf62 >2013-12-04 09:11:26,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1fa6d42 >2013-12-04 09:11:26,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afcd8ae8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@487018b2}, log id: 1fa6d42 >2013-12-04 09:11:31,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 622ff31e >2013-12-04 09:11:32,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 622ff31e >2013-12-04 09:11:32,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1f4ea3a8 >2013-12-04 09:11:32,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd1282c3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c56c6e8c}, log id: 1f4ea3a8 >2013-12-04 09:11:37,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20ff8708 >2013-12-04 09:11:38,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 20ff8708 >2013-12-04 09:11:38,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59fe3d71 >2013-12-04 09:11:38,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbb6eb4a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be8079eb}, log id: 59fe3d71 >2013-12-04 09:11:43,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e377ee1 >2013-12-04 09:11:44,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e377ee1 >2013-12-04 09:11:44,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21c5ec07 >2013-12-04 09:11:44,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5026bbf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15516671}, log id: 21c5ec07 >2013-12-04 09:11:45,048 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-04 09:11:45,069 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:11:45,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54ada658 >2013-12-04 09:11:45,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 54ada658 >2013-12-04 09:11:49,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1de0b459 >2013-12-04 09:11:49,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1de0b459 >2013-12-04 09:11:49,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 490d715c >2013-12-04 09:11:50,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6da00dc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0be4a0}, log id: 490d715c >2013-12-04 09:11:55,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1912e3a2 >2013-12-04 09:11:55,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1912e3a2 >2013-12-04 09:11:55,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b058e23 >2013-12-04 09:11:55,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c320ecd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebbd350a}, log id: 1b058e23 >2013-12-04 09:12:00,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 544d5318 >2013-12-04 09:12:01,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 544d5318 >2013-12-04 09:12:01,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 48c71a16 >2013-12-04 09:12:01,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c17057c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cf3b175}, log id: 48c71a16 >2013-12-04 09:12:06,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 388b7bbd >2013-12-04 09:12:07,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 388b7bbd >2013-12-04 09:12:07,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d50692f >2013-12-04 09:12:07,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55004543, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6d211cc}, log id: 2d50692f >2013-12-04 09:12:12,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 189ac98 >2013-12-04 09:12:13,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 189ac98 >2013-12-04 09:12:13,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d94907d >2013-12-04 09:12:13,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e7e7e3e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a7ade5a}, log id: 2d94907d >2013-12-04 09:12:18,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 295a794e >2013-12-04 09:12:18,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 295a794e >2013-12-04 09:12:18,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4ca6430 >2013-12-04 09:12:19,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@601ca5fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@362eebcc}, log id: 4ca6430 >2013-12-04 09:12:24,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 25a02785 >2013-12-04 09:12:24,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 25a02785 >2013-12-04 09:12:24,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1cf8c741 >2013-12-04 09:12:25,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff171e5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe20c98d}, log id: 1cf8c741 >2013-12-04 09:12:30,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1da391ba >2013-12-04 09:12:30,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1da391ba >2013-12-04 09:12:30,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 364fe939 >2013-12-04 09:12:30,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dbf7791, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb9230e8}, log id: 364fe939 >2013-12-04 09:12:35,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 247384a0 >2013-12-04 09:12:36,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 247384a0 >2013-12-04 09:12:36,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e4154bb >2013-12-04 09:12:36,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e521e60c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e43ac05d}, log id: 7e4154bb >2013-12-04 09:12:41,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45df375d >2013-12-04 09:12:42,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 45df375d >2013-12-04 09:12:42,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5e6515f9 >2013-12-04 09:12:42,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d5a0a93, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e5a1688}, log id: 5e6515f9 >2013-12-04 09:12:45,367 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) No up server in cluster >2013-12-04 09:12:45,378 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:12:45,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 576bd9c6 >2013-12-04 09:12:45,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, return: [], log id: 576bd9c6 >2013-12-04 09:12:47,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7c9e8163 >2013-12-04 09:12:48,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7c9e8163 >2013-12-04 09:12:48,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 716803b0 >2013-12-04 09:12:48,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f46cab34, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6142f3b9}, log id: 716803b0 >2013-12-04 09:12:53,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b03a249 >2013-12-04 09:12:53,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b03a249 >2013-12-04 09:12:53,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2728f993 >2013-12-04 09:12:54,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a8475eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25da9cbd}, log id: 2728f993 >2013-12-04 09:12:59,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7cf5bc1e >2013-12-04 09:12:59,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7cf5bc1e >2013-12-04 09:12:59,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 360478bf >2013-12-04 09:12:59,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7373159, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@701f20d1}, log id: 360478bf >2013-12-04 09:13:04,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a4a72a >2013-12-04 09:13:05,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6a4a72a >2013-12-04 09:13:05,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3688c32d >2013-12-04 09:13:05,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ea94ea0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@847de3a6}, log id: 3688c32d >2013-12-04 09:13:10,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1c3e0078 >2013-12-04 09:13:11,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1c3e0078 >2013-12-04 09:13:11,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2f612c11 >2013-12-04 09:13:11,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2469f7d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74e8b2a0}, log id: 2f612c11 >2013-12-04 09:13:16,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4bbe89e2 >2013-12-04 09:13:17,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4bbe89e2 >2013-12-04 09:13:17,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c77a800 >2013-12-04 09:13:17,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c436f6e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2daa33ec}, log id: 6c77a800 >2013-12-04 09:13:22,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59ba2790 >2013-12-04 09:13:22,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 59ba2790 >2013-12-04 09:13:22,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 694105a2 >2013-12-04 09:13:23,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39b2c17e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35f5f196}, log id: 694105a2 >2013-12-04 09:13:28,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4aee910a >2013-12-04 09:13:28,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4aee910a >2013-12-04 09:13:28,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6631a5ee >2013-12-04 09:13:28,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edc5fa79, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7020c5f2}, log id: 6631a5ee >2013-12-04 09:13:34,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77dd0034 >2013-12-04 09:13:34,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 77dd0034 >2013-12-04 09:13:34,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 46d66f7a >2013-12-04 09:13:34,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9544a27a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d973622}, log id: 46d66f7a >2013-12-04 09:13:39,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 674deb64 >2013-12-04 09:13:40,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 674deb64 >2013-12-04 09:13:40,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6d5e939a >2013-12-04 09:13:40,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1c9c890, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b78bf53}, log id: 6d5e939a >2013-12-04 09:13:45,674 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) [1f01d1f] No up server in cluster >2013-12-04 09:13:45,674 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) [1f01d1f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:13:45,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6de23a45 >2013-12-04 09:13:45,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12771534 >2013-12-04 09:13:45,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6de23a45 >2013-12-04 09:13:46,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 12771534 >2013-12-04 09:13:46,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 29338da0 >2013-12-04 09:13:46,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e51439b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@436d7de5}, log id: 29338da0 >2013-12-04 09:13:51,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 11f02b73 >2013-12-04 09:13:52,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 11f02b73 >2013-12-04 09:13:52,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 64230412 >2013-12-04 09:13:52,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95514cfe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e34d483}, log id: 64230412 >2013-12-04 09:13:57,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 537480e4 >2013-12-04 09:13:57,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 537480e4 >2013-12-04 09:13:57,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2acd1e76 >2013-12-04 09:13:58,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f33cd17e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5f48674}, log id: 2acd1e76 >2013-12-04 09:14:03,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 48609b3d >2013-12-04 09:14:03,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 48609b3d >2013-12-04 09:14:03,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54a3d35a >2013-12-04 09:14:04,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec5398cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2626219}, log id: 54a3d35a >2013-12-04 09:14:09,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58f78284 >2013-12-04 09:14:09,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 58f78284 >2013-12-04 09:14:09,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71a1e2d2 >2013-12-04 09:14:09,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3f51700, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5faba2cd}, log id: 71a1e2d2 >2013-12-04 09:14:14,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 682a8bdb >2013-12-04 09:14:15,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 682a8bdb >2013-12-04 09:14:15,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10579020 >2013-12-04 09:14:15,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7c3fba7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50492c}, log id: 10579020 >2013-12-04 09:14:20,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c19019e >2013-12-04 09:14:21,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6c19019e >2013-12-04 09:14:21,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7d580bce >2013-12-04 09:14:21,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8ceef01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@264fc8e6}, log id: 7d580bce >2013-12-04 09:14:26,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10946f08 >2013-12-04 09:14:26,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 10946f08 >2013-12-04 09:14:26,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5c6f67e1 >2013-12-04 09:14:27,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adbdcfa0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef2f0594}, log id: 5c6f67e1 >2013-12-04 09:14:31,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c378d9e >2013-12-04 09:14:31,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@553e8c20, log id: 2c378d9e >2013-12-04 09:14:31,697 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-56) [49a6fca1] Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:14:31,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7d61b498 >2013-12-04 09:14:31,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@729e9b35, log id: 7d61b498 >2013-12-04 09:14:32,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 427d3775 >2013-12-04 09:14:32,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 427d3775 >2013-12-04 09:14:32,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2240cff3 >2013-12-04 09:14:32,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4176726, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62e897f3}, log id: 2240cff3 >2013-12-04 09:14:38,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7fd3ca7c >2013-12-04 09:14:38,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7fd3ca7c >2013-12-04 09:14:38,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e1ccc38 >2013-12-04 09:14:38,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82a7c6b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca3a6ddf}, log id: 7e1ccc38 >2013-12-04 09:14:43,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2263df13 >2013-12-04 09:14:44,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2263df13 >2013-12-04 09:14:44,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f731b73 >2013-12-04 09:14:44,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adb4c0c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdc802a1}, log id: 4f731b73 >2013-12-04 09:14:45,965 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-04 09:14:45,986 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:14:45,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2735d17 >2013-12-04 09:14:46,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2735d17 >2013-12-04 09:14:49,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6a9e5719 >2013-12-04 09:14:50,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a9e5719 >2013-12-04 09:14:50,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 129e9182 >2013-12-04 09:14:50,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe95de8f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a64f3da4}, log id: 129e9182 >2013-12-04 09:14:55,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 795239d6 >2013-12-04 09:14:55,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 795239d6 >2013-12-04 09:14:55,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5835e48f >2013-12-04 09:14:56,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6a8c2b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f797cbf}, log id: 5835e48f >2013-12-04 09:15:01,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a9afce9 >2013-12-04 09:15:01,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5a9afce9 >2013-12-04 09:15:01,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10d7def8 >2013-12-04 09:15:01,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb395c3a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37d8f655}, log id: 10d7def8 >2013-12-04 09:15:07,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: cc6cd96 >2013-12-04 09:15:07,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: cc6cd96 >2013-12-04 09:15:07,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10261107 >2013-12-04 09:15:07,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a91dd26, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77bf9f27}, log id: 10261107 >2013-12-04 09:15:12,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9dbe96e >2013-12-04 09:15:13,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 9dbe96e >2013-12-04 09:15:13,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 720962e1 >2013-12-04 09:15:13,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df7a8680, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f97829ee}, log id: 720962e1 >2013-12-04 09:15:18,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a6a6c6f >2013-12-04 09:15:19,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a6a6c6f >2013-12-04 09:15:19,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58d536f7 >2013-12-04 09:15:19,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@575fe468, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bb20405}, log id: 58d536f7 >2013-12-04 09:15:24,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39ed31d4 >2013-12-04 09:15:24,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 39ed31d4 >2013-12-04 09:15:24,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 376848e3 >2013-12-04 09:15:25,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a857a5f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@899f16ca}, log id: 376848e3 >2013-12-04 09:15:30,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2aa90765 >2013-12-04 09:15:30,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2aa90765 >2013-12-04 09:15:30,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50fecb60 >2013-12-04 09:15:31,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@969bef20, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50f604c4}, log id: 50fecb60 >2013-12-04 09:15:36,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e2803ca >2013-12-04 09:15:36,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e2803ca >2013-12-04 09:15:36,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e7aa0c7 >2013-12-04 09:15:36,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12bde342, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a659733}, log id: 2e7aa0c7 >2013-12-04 09:15:41,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28de5f02 >2013-12-04 09:15:42,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 28de5f02 >2013-12-04 09:15:42,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: e5fcb8c >2013-12-04 09:15:42,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@336ce72, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ff5f197}, log id: e5fcb8c >2013-12-04 09:15:46,289 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) No up server in cluster >2013-12-04 09:15:46,299 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:15:46,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: bcf9852 >2013-12-04 09:15:46,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterTasksListVDSCommand, return: [], log id: bcf9852 >2013-12-04 09:15:47,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6e3fa7a6 >2013-12-04 09:15:48,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e3fa7a6 >2013-12-04 09:15:48,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 923e0b9 >2013-12-04 09:15:48,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b78d9cea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d06935b}, log id: 923e0b9 >2013-12-04 09:15:53,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 549a1098 >2013-12-04 09:15:54,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 549a1098 >2013-12-04 09:15:54,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12631397 >2013-12-04 09:15:54,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1660522d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@771919c0}, log id: 12631397 >2013-12-04 09:15:59,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5166dc5d >2013-12-04 09:15:59,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5166dc5d >2013-12-04 09:15:59,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 22c912eb >2013-12-04 09:16:00,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4147b692, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@899e7ca9}, log id: 22c912eb >2013-12-04 09:16:05,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a2ddbc0 >2013-12-04 09:16:05,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a2ddbc0 >2013-12-04 09:16:05,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38ce0ae7 >2013-12-04 09:16:06,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9988b865, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d572e20e}, log id: 38ce0ae7 >2013-12-04 09:16:11,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 11be8e34 >2013-12-04 09:16:11,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 11be8e34 >2013-12-04 09:16:11,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9beb96b >2013-12-04 09:16:11,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@285b37aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@554a7de3}, log id: 9beb96b >2013-12-04 09:16:16,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35e5f562 >2013-12-04 09:16:17,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 35e5f562 >2013-12-04 09:16:17,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a485b98 >2013-12-04 09:16:17,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c79b3bba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@586bb980}, log id: 1a485b98 >2013-12-04 09:16:22,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b57220a >2013-12-04 09:16:23,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4b57220a >2013-12-04 09:16:23,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 908d509 >2013-12-04 09:16:23,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cffe97c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a56e7ba}, log id: 908d509 >2013-12-04 09:16:28,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2969355f >2013-12-04 09:16:29,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2969355f >2013-12-04 09:16:29,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 532b8640 >2013-12-04 09:16:29,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1960653, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be83cad4}, log id: 532b8640 >2013-12-04 09:16:34,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 53d31045 >2013-12-04 09:16:34,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 53d31045 >2013-12-04 09:16:34,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66600ff1 >2013-12-04 09:16:35,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cc9ae73, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1aeb2f04}, log id: 66600ff1 >2013-12-04 09:16:40,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 357dfaba >2013-12-04 09:16:40,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 357dfaba >2013-12-04 09:16:40,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 799ba567 >2013-12-04 09:16:40,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@560769c3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4ee63d7}, log id: 799ba567 >2013-12-04 09:16:45,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3769ab75 >2013-12-04 09:16:46,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3769ab75 >2013-12-04 09:16:46,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 61e4289c >2013-12-04 09:16:46,625 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) No up server in cluster >2013-12-04 09:16:46,626 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:16:46,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2f5bafa8 >2013-12-04 09:16:46,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ff6f795, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@114611b2}, log id: 61e4289c >2013-12-04 09:16:46,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2f5bafa8 >2013-12-04 09:16:51,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 23efa1ec >2013-12-04 09:16:52,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 23efa1ec >2013-12-04 09:16:52,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47936c17 >2013-12-04 09:16:52,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92652578, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@326a8c14}, log id: 47936c17 >2013-12-04 09:16:57,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3bbea115 >2013-12-04 09:16:58,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3bbea115 >2013-12-04 09:16:58,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6c1f2104 >2013-12-04 09:16:58,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91cd50d4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f15b801}, log id: 6c1f2104 >2013-12-04 09:17:03,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 422d9846 >2013-12-04 09:17:03,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 422d9846 >2013-12-04 09:17:03,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 62a256fa >2013-12-04 09:17:04,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fa4322a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3400ecd6}, log id: 62a256fa >2013-12-04 09:17:09,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5bf6b1c3 >2013-12-04 09:17:09,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5bf6b1c3 >2013-12-04 09:17:09,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6bafdec >2013-12-04 09:17:09,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bac48674, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8007cdad}, log id: 6bafdec >2013-12-04 09:17:15,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: d329d54 >2013-12-04 09:17:15,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: d329d54 >2013-12-04 09:17:15,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1f9bd495 >2013-12-04 09:17:15,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65ac6dae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a626db64}, log id: 1f9bd495 >2013-12-04 09:17:20,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6cb999fc >2013-12-04 09:17:21,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6cb999fc >2013-12-04 09:17:21,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17c2f3ce >2013-12-04 09:17:21,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3554423f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b15bccad}, log id: 17c2f3ce >2013-12-04 09:17:26,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: e8d63a2 >2013-12-04 09:17:27,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: e8d63a2 >2013-12-04 09:17:27,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 68775079 >2013-12-04 09:17:27,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7af5050d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2ad30c0}, log id: 68775079 >2013-12-04 09:17:32,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3236f7f8 >2013-12-04 09:17:32,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3236f7f8 >2013-12-04 09:17:32,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 729a19f9 >2013-12-04 09:17:33,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cd4a3c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87c5aa14}, log id: 729a19f9 >2013-12-04 09:17:38,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6aa7158d >2013-12-04 09:17:38,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6aa7158d >2013-12-04 09:17:38,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 95748c6 >2013-12-04 09:17:39,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7747f0cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d5347ea}, log id: 95748c6 >2013-12-04 09:17:44,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b975f33 >2013-12-04 09:17:44,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7b975f33 >2013-12-04 09:17:44,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56f6a749 >2013-12-04 09:17:44,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0f29ff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2dec8d5c}, log id: 56f6a749 >2013-12-04 09:17:46,925 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) No up server in cluster >2013-12-04 09:17:46,933 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:17:46,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 664d381d >2013-12-04 09:17:47,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterTasksListVDSCommand, return: [], log id: 664d381d >2013-12-04 09:17:49,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2de68387 >2013-12-04 09:17:50,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2de68387 >2013-12-04 09:17:50,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 172539c0 >2013-12-04 09:17:50,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cecb5c21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb5577b6}, log id: 172539c0 >2013-12-04 09:17:55,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 43e6fbb7 >2013-12-04 09:17:56,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 43e6fbb7 >2013-12-04 09:17:56,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1636f08a >2013-12-04 09:17:56,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65ddd75b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd785e93}, log id: 1636f08a >2013-12-04 09:18:01,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c8b1a6a >2013-12-04 09:18:01,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5c8b1a6a >2013-12-04 09:18:01,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 298d3e77 >2013-12-04 09:18:02,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d828930, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7720fd42}, log id: 298d3e77 >2013-12-04 09:18:07,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 421af7de >2013-12-04 09:18:07,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 421af7de >2013-12-04 09:18:07,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 752a89e8 >2013-12-04 09:18:08,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abdc0d3e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@802f15d9}, log id: 752a89e8 >2013-12-04 09:18:13,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5714de2f >2013-12-04 09:18:13,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5714de2f >2013-12-04 09:18:13,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 42186958 >2013-12-04 09:18:13,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@424b29f2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10e11ca8}, log id: 42186958 >2013-12-04 09:18:18,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6aa24de1 >2013-12-04 09:18:19,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6aa24de1 >2013-12-04 09:18:19,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 78b3d82f >2013-12-04 09:18:19,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a815f47, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1db66aa1}, log id: 78b3d82f >2013-12-04 09:18:24,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19656363 >2013-12-04 09:18:25,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 19656363 >2013-12-04 09:18:25,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: da7a9eb >2013-12-04 09:18:25,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c92a25ce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1e0d618}, log id: da7a9eb >2013-12-04 09:18:30,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 56e88eef >2013-12-04 09:18:31,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 56e88eef >2013-12-04 09:18:31,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 774903cf >2013-12-04 09:18:31,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc5822a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e2c605b}, log id: 774903cf >2013-12-04 09:18:36,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d84f61e >2013-12-04 09:18:36,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3d84f61e >2013-12-04 09:18:36,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4c38b290 >2013-12-04 09:18:37,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66cf093c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b748525a}, log id: 4c38b290 >2013-12-04 09:18:42,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22dc3eb8 >2013-12-04 09:18:42,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 22dc3eb8 >2013-12-04 09:18:42,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 31e61aec >2013-12-04 09:18:42,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5fff3c9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb7a9212}, log id: 31e61aec >2013-12-04 09:18:47,227 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) [5be76bf9] No up server in cluster >2013-12-04 09:18:47,266 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) [5be76bf9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:18:47,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4728c78e >2013-12-04 09:18:47,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4728c78e >2013-12-04 09:18:48,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 56eb89ea >2013-12-04 09:18:48,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 56eb89ea >2013-12-04 09:18:48,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 538527f >2013-12-04 09:18:48,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a51a9b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e59a0647}, log id: 538527f >2013-12-04 09:18:53,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7b409605 >2013-12-04 09:18:54,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b409605 >2013-12-04 09:18:54,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6e61b6c >2013-12-04 09:18:54,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2efb1d77, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a14e8fa}, log id: 6e61b6c >2013-12-04 09:18:59,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 72d5e6ac >2013-12-04 09:19:00,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 72d5e6ac >2013-12-04 09:19:00,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6686678c >2013-12-04 09:19:00,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d08e5286, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@813a4296}, log id: 6686678c >2013-12-04 09:19:05,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 23322f45 >2013-12-04 09:19:05,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 23322f45 >2013-12-04 09:19:05,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d2fca3f >2013-12-04 09:19:06,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f5f678b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@147dd123}, log id: 2d2fca3f >2013-12-04 09:19:11,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: d28b5c1 >2013-12-04 09:19:11,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: d28b5c1 >2013-12-04 09:19:11,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 13dd35b1 >2013-12-04 09:19:12,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19546ce0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb17b437}, log id: 13dd35b1 >2013-12-04 09:19:17,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3176d5d1 >2013-12-04 09:19:17,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3176d5d1 >2013-12-04 09:19:17,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32e36637 >2013-12-04 09:19:17,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fbcd9de, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa321da4}, log id: 32e36637 >2013-12-04 09:19:22,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1108688 >2013-12-04 09:19:23,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1108688 >2013-12-04 09:19:23,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a6745fb >2013-12-04 09:19:23,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb94fa08, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19df7f57}, log id: 5a6745fb >2013-12-04 09:19:28,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6363aaf9 >2013-12-04 09:19:29,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6363aaf9 >2013-12-04 09:19:29,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1a57214d >2013-12-04 09:19:29,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2201d885, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bc845f0}, log id: 1a57214d >2013-12-04 09:19:31,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 11af388d >2013-12-04 09:19:32,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@cd07713, log id: 11af388d >2013-12-04 09:19:32,269 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-11) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:19:32,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4a3986f7 >2013-12-04 09:19:32,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7b6de813, log id: 4a3986f7 >2013-12-04 09:19:34,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5faf3689 >2013-12-04 09:19:34,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5faf3689 >2013-12-04 09:19:34,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e9887da >2013-12-04 09:19:35,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b629e43d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fd7cb0e}, log id: 2e9887da >2013-12-04 09:19:40,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 590747f2 >2013-12-04 09:19:40,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 590747f2 >2013-12-04 09:19:40,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 371fbec0 >2013-12-04 09:19:41,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0472d6a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@477c5d72}, log id: 371fbec0 >2013-12-04 09:19:46,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40c41da0 >2013-12-04 09:19:46,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 40c41da0 >2013-12-04 09:19:46,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20af0565 >2013-12-04 09:19:46,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@986c6f77, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec0846c6}, log id: 20af0565 >2013-12-04 09:19:47,571 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-04 09:19:47,571 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:19:47,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20db9cd >2013-12-04 09:19:47,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: 20db9cd >2013-12-04 09:19:51,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 182e319 >2013-12-04 09:19:52,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 182e319 >2013-12-04 09:19:52,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63fea0f5 >2013-12-04 09:19:52,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9903a78c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9226f6b1}, log id: 63fea0f5 >2013-12-04 09:19:57,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43d3e4a >2013-12-04 09:19:58,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 43d3e4a >2013-12-04 09:19:58,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3830148b >2013-12-04 09:19:58,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3f12e0b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b35d9542}, log id: 3830148b >2013-12-04 09:20:03,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7813f0e >2013-12-04 09:20:04,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7813f0e >2013-12-04 09:20:04,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5ec2074c >2013-12-04 09:20:04,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6613a753, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd5b1abd}, log id: 5ec2074c >2013-12-04 09:20:09,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39cb1858 >2013-12-04 09:20:09,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 39cb1858 >2013-12-04 09:20:09,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 58347ff5 >2013-12-04 09:20:10,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e25b842e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4846157f}, log id: 58347ff5 >2013-12-04 09:20:15,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34684fd0 >2013-12-04 09:20:15,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 34684fd0 >2013-12-04 09:20:15,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 76d0d520 >2013-12-04 09:20:16,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e0a9d59, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@852ee989}, log id: 76d0d520 >2013-12-04 09:20:21,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7fcfc801 >2013-12-04 09:20:21,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fcfc801 >2013-12-04 09:20:21,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2ae30d84 >2013-12-04 09:20:21,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8acf2528, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4554aaa6}, log id: 2ae30d84 >2013-12-04 09:20:26,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d48d31f >2013-12-04 09:20:27,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4d48d31f >2013-12-04 09:20:27,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b837172 >2013-12-04 09:20:27,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f90af0b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@750522f9}, log id: 7b837172 >2013-12-04 09:20:32,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 540a8a73 >2013-12-04 09:20:33,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 540a8a73 >2013-12-04 09:20:33,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 456583dc >2013-12-04 09:20:33,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2f64392, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eecd70aa}, log id: 456583dc >2013-12-04 09:20:38,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7c1c207a >2013-12-04 09:20:38,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7c1c207a >2013-12-04 09:20:38,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2de9b0e0 >2013-12-04 09:20:39,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fc36764, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d927a4b2}, log id: 2de9b0e0 >2013-12-04 09:20:44,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3854a45 >2013-12-04 09:20:44,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3854a45 >2013-12-04 09:20:44,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: f6aa8b5 >2013-12-04 09:20:45,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29949728, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95d59c0d}, log id: f6aa8b5 >2013-12-04 09:20:47,891 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [6d2d632b] No up server in cluster >2013-12-04 09:20:47,910 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [6d2d632b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:20:47,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b8674d3 >2013-12-04 09:20:48,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3b8674d3 >2013-12-04 09:20:50,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7b6dc5cf >2013-12-04 09:20:50,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7b6dc5cf >2013-12-04 09:20:50,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 49dc8c94 >2013-12-04 09:20:50,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1347566a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ca6c326}, log id: 49dc8c94 >2013-12-04 09:20:55,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: f73ffe0 >2013-12-04 09:20:56,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: f73ffe0 >2013-12-04 09:20:56,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c3ee2f >2013-12-04 09:20:56,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e64e7349, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@834a798}, log id: 4c3ee2f >2013-12-04 09:21:01,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e9f2b13 >2013-12-04 09:21:02,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e9f2b13 >2013-12-04 09:21:02,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18666199 >2013-12-04 09:21:02,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4bf1b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@870bb589}, log id: 18666199 >2013-12-04 09:21:07,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 503c9d0 >2013-12-04 09:21:08,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 503c9d0 >2013-12-04 09:21:08,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43240ece >2013-12-04 09:21:08,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@236238b6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df7b8810}, log id: 43240ece >2013-12-04 09:21:13,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: b32f343 >2013-12-04 09:21:13,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: b32f343 >2013-12-04 09:21:13,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3bff8f20 >2013-12-04 09:21:14,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5703500e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@823e9ba6}, log id: 3bff8f20 >2013-12-04 09:21:19,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4e527203 >2013-12-04 09:21:19,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4e527203 >2013-12-04 09:21:19,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b13c158 >2013-12-04 09:21:20,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3aed4873, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c243cb7}, log id: 6b13c158 >2013-12-04 09:21:25,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 722ef347 >2013-12-04 09:21:25,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 722ef347 >2013-12-04 09:21:25,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: e5cfff5 >2013-12-04 09:21:25,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5683c04c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45e16a72}, log id: e5cfff5 >2013-12-04 09:21:30,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 54644d8e >2013-12-04 09:21:31,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 54644d8e >2013-12-04 09:21:31,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 119b4cb3 >2013-12-04 09:21:31,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a850b85, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a35c680c}, log id: 119b4cb3 >2013-12-04 09:21:36,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7eff167b >2013-12-04 09:21:37,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7eff167b >2013-12-04 09:21:37,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40a033f8 >2013-12-04 09:21:37,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@604a4861, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45d1d0e9}, log id: 40a033f8 >2013-12-04 09:21:42,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4a4783e >2013-12-04 09:21:43,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a4783e >2013-12-04 09:21:43,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 45c4b5b5 >2013-12-04 09:21:43,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c0890eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84431bbb}, log id: 45c4b5b5 >2013-12-04 09:21:48,219 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) No up server in cluster >2013-12-04 09:21:48,219 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:21:48,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6cc9b052 >2013-12-04 09:21:48,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 42e027a5 >2013-12-04 09:21:48,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6cc9b052 >2013-12-04 09:21:48,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 42e027a5 >2013-12-04 09:21:48,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 50cdd98 >2013-12-04 09:21:49,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7518b939, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8aa743e9}, log id: 50cdd98 >2013-12-04 09:21:54,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45fedbe5 >2013-12-04 09:21:54,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 45fedbe5 >2013-12-04 09:21:54,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 658a10ae >2013-12-04 09:21:54,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2842af66, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f06d1fa}, log id: 658a10ae >2013-12-04 09:21:59,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 48163e55 >2013-12-04 09:22:00,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 48163e55 >2013-12-04 09:22:00,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 22fdadb1 >2013-12-04 09:22:00,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@844bbfd9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40502790}, log id: 22fdadb1 >2013-12-04 09:22:05,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 377073eb >2013-12-04 09:22:06,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 377073eb >2013-12-04 09:22:06,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3e16fea3 >2013-12-04 09:22:06,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e558f05a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8ae9a40}, log id: 3e16fea3 >2013-12-04 09:22:11,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5017ad9e >2013-12-04 09:22:12,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5017ad9e >2013-12-04 09:22:12,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ab9cf20 >2013-12-04 09:22:12,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@350b0dfb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3d96d4f}, log id: 7ab9cf20 >2013-12-04 09:22:17,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4cdd5c2d >2013-12-04 09:22:17,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4cdd5c2d >2013-12-04 09:22:17,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5ec7bfc0 >2013-12-04 09:22:18,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1a283cb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f15eef26}, log id: 5ec7bfc0 >2013-12-04 09:22:23,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4df0211d >2013-12-04 09:22:23,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4df0211d >2013-12-04 09:22:23,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5787c7a0 >2013-12-04 09:22:24,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@916cbed9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da60af10}, log id: 5787c7a0 >2013-12-04 09:22:29,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3dac4dac >2013-12-04 09:22:29,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3dac4dac >2013-12-04 09:22:29,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5007b264 >2013-12-04 09:22:29,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@673e7f1a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9d52b}, log id: 5007b264 >2013-12-04 09:22:34,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1127b2c1 >2013-12-04 09:22:35,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1127b2c1 >2013-12-04 09:22:35,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: c984a6 >2013-12-04 09:22:35,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@553c48db, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ed1254a}, log id: c984a6 >2013-12-04 09:22:40,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11e02525 >2013-12-04 09:22:41,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 11e02525 >2013-12-04 09:22:41,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1efda3a >2013-12-04 09:22:41,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53b348e1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cfbc818}, log id: 1efda3a >2013-12-04 09:22:46,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 151fb3fd >2013-12-04 09:22:46,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 151fb3fd >2013-12-04 09:22:46,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2161e123 >2013-12-04 09:22:47,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d680bbb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37fbdbc1}, log id: 2161e123 >2013-12-04 09:22:48,527 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-04 09:22:48,533 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:22:48,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: bfa50a5 >2013-12-04 09:22:48,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: bfa50a5 >2013-12-04 09:22:52,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5d7b4f6d >2013-12-04 09:22:52,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5d7b4f6d >2013-12-04 09:22:52,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 470a5067 >2013-12-04 09:22:53,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f91ae048, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a69fe6}, log id: 470a5067 >2013-12-04 09:22:58,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 786f982a >2013-12-04 09:22:58,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 786f982a >2013-12-04 09:22:58,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d4cfcc4 >2013-12-04 09:22:58,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d590938, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24b4b6be}, log id: 2d4cfcc4 >2013-12-04 09:23:03,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5fa5fc05 >2013-12-04 09:23:04,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5fa5fc05 >2013-12-04 09:23:04,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59b14e15 >2013-12-04 09:23:04,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@879ddc1f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98756de4}, log id: 59b14e15 >2013-12-04 09:23:09,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1e59c9a6 >2013-12-04 09:23:10,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1e59c9a6 >2013-12-04 09:23:10,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28c5c419 >2013-12-04 09:23:10,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b42b464e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fed14365}, log id: 28c5c419 >2013-12-04 09:23:15,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56bd14e9 >2013-12-04 09:23:16,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 56bd14e9 >2013-12-04 09:23:16,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6f03af37 >2013-12-04 09:23:16,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a28f3e05, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be8f2a9f}, log id: 6f03af37 >2013-12-04 09:23:21,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 795cbe52 >2013-12-04 09:23:21,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 795cbe52 >2013-12-04 09:23:21,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 13791ffb >2013-12-04 09:23:22,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@138ed7dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23e0de77}, log id: 13791ffb >2013-12-04 09:23:27,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18513a14 >2013-12-04 09:23:27,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 18513a14 >2013-12-04 09:23:27,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1bacba6f >2013-12-04 09:23:27,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a6fb9be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65ec1c57}, log id: 1bacba6f >2013-12-04 09:23:32,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 72553db >2013-12-04 09:23:33,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 72553db >2013-12-04 09:23:33,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e4a0c34 >2013-12-04 09:23:33,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3ce7428, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb5b7605}, log id: 2e4a0c34 >2013-12-04 09:23:38,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 58d5db55 >2013-12-04 09:23:39,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 58d5db55 >2013-12-04 09:23:39,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3faba2ba >2013-12-04 09:23:39,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e59e4f1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be77dd0c}, log id: 3faba2ba >2013-12-04 09:23:44,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a3b4dab >2013-12-04 09:23:45,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3a3b4dab >2013-12-04 09:23:45,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40ac1466 >2013-12-04 09:23:45,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1f21482, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94d70e6a}, log id: 40ac1466 >2013-12-04 09:23:48,848 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-89) No up server in cluster >2013-12-04 09:23:48,876 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-89) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:23:48,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 737afc4b >2013-12-04 09:23:49,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterTasksListVDSCommand, return: [], log id: 737afc4b >2013-12-04 09:23:50,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 361b343f >2013-12-04 09:23:50,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 361b343f >2013-12-04 09:23:50,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 537bf2cb >2013-12-04 09:23:51,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f155bad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef0af732}, log id: 537bf2cb >2013-12-04 09:23:56,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 37d5f563 >2013-12-04 09:23:56,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 37d5f563 >2013-12-04 09:23:56,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: e0d788d >2013-12-04 09:23:57,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3621fba7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5916996}, log id: e0d788d >2013-12-04 09:24:02,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1fa03d43 >2013-12-04 09:24:02,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1fa03d43 >2013-12-04 09:24:02,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 779c1df5 >2013-12-04 09:24:02,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9faaec68, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c32363ad}, log id: 779c1df5 >2013-12-04 09:24:07,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6e8e517c >2013-12-04 09:24:08,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6e8e517c >2013-12-04 09:24:08,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 105ecb19 >2013-12-04 09:24:08,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4dc7ed2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@556b48a0}, log id: 105ecb19 >2013-12-04 09:24:13,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6f76a550 >2013-12-04 09:24:14,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f76a550 >2013-12-04 09:24:14,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 37e268d2 >2013-12-04 09:24:14,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5782c2c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@406475bf}, log id: 37e268d2 >2013-12-04 09:24:19,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e90cf1b >2013-12-04 09:24:20,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7e90cf1b >2013-12-04 09:24:20,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59f1085d >2013-12-04 09:24:20,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a4aebe1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fe16f3c}, log id: 59f1085d >2013-12-04 09:24:25,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7c10b54b >2013-12-04 09:24:25,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7c10b54b >2013-12-04 09:24:25,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 641a2abf >2013-12-04 09:24:26,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38913eb2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f93e7ef}, log id: 641a2abf >2013-12-04 09:24:31,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 181aef0d >2013-12-04 09:24:31,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 181aef0d >2013-12-04 09:24:31,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e9afd7b >2013-12-04 09:24:31,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6e108d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73181460}, log id: 2e9afd7b >2013-12-04 09:24:32,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: f454c27 >2013-12-04 09:24:32,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@423a4bae, log id: f454c27 >2013-12-04 09:24:32,867 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-62) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:24:32,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 13eae7a >2013-12-04 09:24:33,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2a29d99e, log id: 13eae7a >2013-12-04 09:24:37,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 36d73a69 >2013-12-04 09:24:37,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36d73a69 >2013-12-04 09:24:37,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4a4e0bc8 >2013-12-04 09:24:37,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb1b4332, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c193d100}, log id: 4a4e0bc8 >2013-12-04 09:24:42,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 44c70dd8 >2013-12-04 09:24:43,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 44c70dd8 >2013-12-04 09:24:43,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 71e04d0f >2013-12-04 09:24:43,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c59d95c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dc86b5b}, log id: 71e04d0f >2013-12-04 09:24:48,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59af54f5 >2013-12-04 09:24:49,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 59af54f5 >2013-12-04 09:24:49,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3aa66496 >2013-12-04 09:24:49,178 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-04 09:24:49,190 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:24:49,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 684032b5 >2013-12-04 09:24:49,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74a4ccca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7aad463}, log id: 3aa66496 >2013-12-04 09:24:49,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 684032b5 >2013-12-04 09:24:54,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47f7c434 >2013-12-04 09:24:54,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 47f7c434 >2013-12-04 09:24:54,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 655f4e23 >2013-12-04 09:24:55,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8641ee97, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43de0b0}, log id: 655f4e23 >2013-12-04 09:25:00,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1319a74 >2013-12-04 09:25:00,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1319a74 >2013-12-04 09:25:00,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24c5cf6d >2013-12-04 09:25:00,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a323940, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea2cb2a5}, log id: 24c5cf6d >2013-12-04 09:25:06,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f901c2e >2013-12-04 09:25:06,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4f901c2e >2013-12-04 09:25:06,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 414ed188 >2013-12-04 09:25:06,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e108685, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ced8a36d}, log id: 414ed188 >2013-12-04 09:25:11,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 62263f84 >2013-12-04 09:25:12,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 62263f84 >2013-12-04 09:25:12,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b139023 >2013-12-04 09:25:12,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9c8aea8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18d9d812}, log id: 7b139023 >2013-12-04 09:25:17,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3925b15d >2013-12-04 09:25:18,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3925b15d >2013-12-04 09:25:18,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 635b6bc8 >2013-12-04 09:25:18,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6ecf0bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83324fe}, log id: 635b6bc8 >2013-12-04 09:25:23,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3df23aff >2013-12-04 09:25:24,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3df23aff >2013-12-04 09:25:24,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5320f032 >2013-12-04 09:25:24,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7a400a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20ea179e}, log id: 5320f032 >2013-12-04 09:25:29,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f35f18e >2013-12-04 09:25:29,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7f35f18e >2013-12-04 09:25:29,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78672cbe >2013-12-04 09:25:30,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fc82d12, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b38a85d2}, log id: 78672cbe >2013-12-04 09:25:35,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2dfa500e >2013-12-04 09:25:35,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2dfa500e >2013-12-04 09:25:35,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2edbf29e >2013-12-04 09:25:35,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5efe9e57, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4a82e3d}, log id: 2edbf29e >2013-12-04 09:25:40,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 74591948 >2013-12-04 09:25:41,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 74591948 >2013-12-04 09:25:41,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 69f88da4 >2013-12-04 09:25:41,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42f188d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d7343aa}, log id: 69f88da4 >2013-12-04 09:25:46,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ff11d96 >2013-12-04 09:25:47,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1ff11d96 >2013-12-04 09:25:47,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41a01f64 >2013-12-04 09:25:47,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9201e87, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5850b366}, log id: 41a01f64 >2013-12-04 09:25:49,497 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-04 09:25:49,497 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:25:49,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6f336f12 >2013-12-04 09:25:49,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f336f12 >2013-12-04 09:25:52,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 384f5ae1 >2013-12-04 09:25:53,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 384f5ae1 >2013-12-04 09:25:53,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 71101e82 >2013-12-04 09:25:53,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e95b054, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab3a52f3}, log id: 71101e82 >2013-12-04 09:25:58,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 72a8007f >2013-12-04 09:25:59,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 72a8007f >2013-12-04 09:25:59,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d6054c3 >2013-12-04 09:25:59,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@450bc7d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3b910ff}, log id: 4d6054c3 >2013-12-04 09:26:04,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5554592e >2013-12-04 09:26:04,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5554592e >2013-12-04 09:26:04,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4364134b >2013-12-04 09:26:05,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@339657bf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7373688}, log id: 4364134b >2013-12-04 09:26:10,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1436e78a >2013-12-04 09:26:10,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1436e78a >2013-12-04 09:26:10,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3f1da9af >2013-12-04 09:26:11,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a759ab4f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c7c2e6e}, log id: 3f1da9af >2013-12-04 09:26:16,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 28e3cb44 >2013-12-04 09:26:16,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 28e3cb44 >2013-12-04 09:26:16,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 49cadb34 >2013-12-04 09:26:16,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49d12ae4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4dab4ec}, log id: 49cadb34 >2013-12-04 09:26:21,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38e93e66 >2013-12-04 09:26:22,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 38e93e66 >2013-12-04 09:26:22,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c7b74bd >2013-12-04 09:26:22,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c96851f0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@721918eb}, log id: 1c7b74bd >2013-12-04 09:26:27,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 74a6fce6 >2013-12-04 09:26:28,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 74a6fce6 >2013-12-04 09:26:28,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5fd55d0c >2013-12-04 09:26:28,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a25e523a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f890b8c2}, log id: 5fd55d0c >2013-12-04 09:26:33,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26ddfe2c >2013-12-04 09:26:33,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 26ddfe2c >2013-12-04 09:26:33,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 11561aa1 >2013-12-04 09:26:34,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f140205, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82b36253}, log id: 11561aa1 >2013-12-04 09:26:39,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 648bb82 >2013-12-04 09:26:39,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 648bb82 >2013-12-04 09:26:39,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3ad9906f >2013-12-04 09:26:40,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9395e24, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47cc83a5}, log id: 3ad9906f >2013-12-04 09:26:45,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b2a9fea >2013-12-04 09:26:45,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7b2a9fea >2013-12-04 09:26:45,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f293a68 >2013-12-04 09:26:45,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7877346, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1111392}, log id: 7f293a68 >2013-12-04 09:26:49,815 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) No up server in cluster >2013-12-04 09:26:49,816 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:26:49,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53580f45 >2013-12-04 09:26:50,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, return: [], log id: 53580f45 >2013-12-04 09:26:50,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: f328df8 >2013-12-04 09:26:51,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: f328df8 >2013-12-04 09:26:51,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2a1a1df7 >2013-12-04 09:26:51,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c79eef5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d03389ba}, log id: 2a1a1df7 >2013-12-04 09:26:56,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63ed0ac0 >2013-12-04 09:26:57,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 63ed0ac0 >2013-12-04 09:26:57,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2c16a99 >2013-12-04 09:26:57,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83da733f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55b76b6e}, log id: 2c16a99 >2013-12-04 09:27:02,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68d20385 >2013-12-04 09:27:03,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 68d20385 >2013-12-04 09:27:03,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4d888fb0 >2013-12-04 09:27:03,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7109b4ff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@379f7501}, log id: 4d888fb0 >2013-12-04 09:27:08,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a252cc1 >2013-12-04 09:27:08,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4a252cc1 >2013-12-04 09:27:08,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4df876d7 >2013-12-04 09:27:09,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17a5b6f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b785019}, log id: 4df876d7 >2013-12-04 09:27:14,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 448908c8 >2013-12-04 09:27:14,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 448908c8 >2013-12-04 09:27:14,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 76f2e6fa >2013-12-04 09:27:15,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9c9aa58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f28c79f7}, log id: 76f2e6fa >2013-12-04 09:27:20,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5efe2bf1 >2013-12-04 09:27:20,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5efe2bf1 >2013-12-04 09:27:20,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 37c7bbe3 >2013-12-04 09:27:20,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69765823, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57898215}, log id: 37c7bbe3 >2013-12-04 09:27:25,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 25a107c7 >2013-12-04 09:27:26,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 25a107c7 >2013-12-04 09:27:26,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74cc35b1 >2013-12-04 09:27:26,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94d49bff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3955bd96}, log id: 74cc35b1 >2013-12-04 09:27:31,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4be001f3 >2013-12-04 09:27:32,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4be001f3 >2013-12-04 09:27:32,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57b3b0fb >2013-12-04 09:27:32,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76b7ed90, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a6d653f}, log id: 57b3b0fb >2013-12-04 09:27:37,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 270f4387 >2013-12-04 09:27:38,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 270f4387 >2013-12-04 09:27:38,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e2821a3 >2013-12-04 09:27:38,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d6e3f7c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dab396}, log id: 4e2821a3 >2013-12-04 09:27:43,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c141bd >2013-12-04 09:27:43,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1c141bd >2013-12-04 09:27:43,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 657ddde2 >2013-12-04 09:27:44,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d522c34, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b5b6547}, log id: 657ddde2 >2013-12-04 09:27:49,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 226e2a15 >2013-12-04 09:27:49,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 226e2a15 >2013-12-04 09:27:49,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 29b92e05 >2013-12-04 09:27:50,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d84084e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3973eb4}, log id: 29b92e05 >2013-12-04 09:27:50,124 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-04 09:27:50,124 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:27:50,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a7d4e15 >2013-12-04 09:27:50,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1a7d4e15 >2013-12-04 09:27:55,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6f57548f >2013-12-04 09:27:55,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f57548f >2013-12-04 09:27:55,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59fe6df2 >2013-12-04 09:27:55,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12a04c8f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a473a60f}, log id: 59fe6df2 >2013-12-04 09:28:00,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7d7c7979 >2013-12-04 09:28:01,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7d7c7979 >2013-12-04 09:28:01,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 141b2d1e >2013-12-04 09:28:01,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@540c054, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9135e580}, log id: 141b2d1e >2013-12-04 09:28:06,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5bff0511 >2013-12-04 09:28:07,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5bff0511 >2013-12-04 09:28:07,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6307e26 >2013-12-04 09:28:07,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acff6cc1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c88ca965}, log id: 6307e26 >2013-12-04 09:28:12,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 8b1f930 >2013-12-04 09:28:13,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 8b1f930 >2013-12-04 09:28:13,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 31cf093e >2013-12-04 09:28:13,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6247bc1d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c74db87}, log id: 31cf093e >2013-12-04 09:28:18,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4762299a >2013-12-04 09:28:18,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4762299a >2013-12-04 09:28:18,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 52440cec >2013-12-04 09:28:19,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39d98c9c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b904ebe}, log id: 52440cec >2013-12-04 09:28:24,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e345da0 >2013-12-04 09:28:24,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e345da0 >2013-12-04 09:28:24,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6bee97ab >2013-12-04 09:28:24,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e99be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c591f5c8}, log id: 6bee97ab >2013-12-04 09:28:30,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c293bc5 >2013-12-04 09:28:30,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2c293bc5 >2013-12-04 09:28:30,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 572ebbd2 >2013-12-04 09:28:30,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@571a407f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6ff632d}, log id: 572ebbd2 >2013-12-04 09:28:35,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11e17e15 >2013-12-04 09:28:36,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 11e17e15 >2013-12-04 09:28:36,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 185d2f4b >2013-12-04 09:28:36,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e20cad49, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eae3f797}, log id: 185d2f4b >2013-12-04 09:28:41,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 190411ad >2013-12-04 09:28:42,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 190411ad >2013-12-04 09:28:42,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ddf31d0 >2013-12-04 09:28:42,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3cb72ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41540}, log id: 2ddf31d0 >2013-12-04 09:28:47,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 272ceebe >2013-12-04 09:28:47,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 272ceebe >2013-12-04 09:28:47,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 12acaa86 >2013-12-04 09:28:48,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2837968, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcc83584}, log id: 12acaa86 >2013-12-04 09:28:50,433 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-04 09:28:50,433 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:28:50,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: cc89ebd >2013-12-04 09:28:50,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: cc89ebd >2013-12-04 09:28:53,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 33c1fc5c >2013-12-04 09:28:53,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 33c1fc5c >2013-12-04 09:28:53,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 332384d >2013-12-04 09:28:54,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b99adf27, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6a94b5b}, log id: 332384d >2013-12-04 09:28:59,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b03e27e >2013-12-04 09:28:59,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: b03e27e >2013-12-04 09:28:59,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59c4d8df >2013-12-04 09:28:59,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38bbf954, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de306849}, log id: 59c4d8df >2013-12-04 09:29:04,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5841c7aa >2013-12-04 09:29:05,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5841c7aa >2013-12-04 09:29:05,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 32a99774 >2013-12-04 09:29:05,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e687205, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d145f83}, log id: 32a99774 >2013-12-04 09:29:10,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26b74c6b >2013-12-04 09:29:11,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 26b74c6b >2013-12-04 09:29:11,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c6fa6db >2013-12-04 09:29:11,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9dfc1fa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bdbef00}, log id: 2c6fa6db >2013-12-04 09:29:16,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1fb763de >2013-12-04 09:29:16,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fb763de >2013-12-04 09:29:16,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7b2fb9cd >2013-12-04 09:29:17,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7caf9942, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d9293ed}, log id: 7b2fb9cd >2013-12-04 09:29:22,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5f0d2ce6 >2013-12-04 09:29:22,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f0d2ce6 >2013-12-04 09:29:22,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 476970c1 >2013-12-04 09:29:23,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@581eb07b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29ea3b94}, log id: 476970c1 >2013-12-04 09:29:28,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 44923908 >2013-12-04 09:29:28,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 44923908 >2013-12-04 09:29:28,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4999bd5e >2013-12-04 09:29:28,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3e61bcc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c171bd2}, log id: 4999bd5e >2013-12-04 09:29:33,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7a79feee >2013-12-04 09:29:33,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2bfdf895, log id: 7a79feee >2013-12-04 09:29:33,491 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-34) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:29:33,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2ecb14c3 >2013-12-04 09:29:33,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7bd54e69, log id: 2ecb14c3 >2013-12-04 09:29:33,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32ae7e44 >2013-12-04 09:29:34,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 32ae7e44 >2013-12-04 09:29:34,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 105e10d1 >2013-12-04 09:29:34,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ac92a4f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3c15ff4}, log id: 105e10d1 >2013-12-04 09:29:39,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2df2878a >2013-12-04 09:29:40,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2df2878a >2013-12-04 09:29:40,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 66de517b >2013-12-04 09:29:40,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9422bd85, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5ef088}, log id: 66de517b >2013-12-04 09:29:45,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3983f13d >2013-12-04 09:29:46,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3983f13d >2013-12-04 09:29:46,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1273387a >2013-12-04 09:29:46,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c922b88, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baf22187}, log id: 1273387a >2013-12-04 09:29:50,737 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) No up server in cluster >2013-12-04 09:29:50,747 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:29:50,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7fea6edb >2013-12-04 09:29:51,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7fea6edb >2013-12-04 09:29:51,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1844b463 >2013-12-04 09:29:51,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1844b463 >2013-12-04 09:29:51,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6357e708 >2013-12-04 09:29:52,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6cc7935, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6a9ede3}, log id: 6357e708 >2013-12-04 09:29:57,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: eb03560 >2013-12-04 09:29:57,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: eb03560 >2013-12-04 09:29:57,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c66f200 >2013-12-04 09:29:58,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99d7060a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcf4f120}, log id: 2c66f200 >2013-12-04 09:30:03,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 45fe684f >2013-12-04 09:30:03,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 45fe684f >2013-12-04 09:30:03,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 49adad72 >2013-12-04 09:30:04,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78f6aa7c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b85c9d9}, log id: 49adad72 >2013-12-04 09:30:09,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 635c19fc >2013-12-04 09:30:09,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 635c19fc >2013-12-04 09:30:09,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 383627d0 >2013-12-04 09:30:09,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3089901, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adea78ac}, log id: 383627d0 >2013-12-04 09:30:14,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 155450c2 >2013-12-04 09:30:15,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 155450c2 >2013-12-04 09:30:15,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26dd5058 >2013-12-04 09:30:15,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7bdbf4b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5cf1898}, log id: 26dd5058 >2013-12-04 09:30:20,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 782675b4 >2013-12-04 09:30:21,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 782675b4 >2013-12-04 09:30:21,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1b6d2ca2 >2013-12-04 09:30:21,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4524eda0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34691c47}, log id: 1b6d2ca2 >2013-12-04 09:30:26,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 52f9e5e8 >2013-12-04 09:30:27,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 52f9e5e8 >2013-12-04 09:30:27,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3294cc77 >2013-12-04 09:30:27,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdb0333f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4b79676}, log id: 3294cc77 >2013-12-04 09:30:32,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45317750 >2013-12-04 09:30:32,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 45317750 >2013-12-04 09:30:32,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19f2e9f0 >2013-12-04 09:30:33,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0f4d40c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@758b9da6}, log id: 19f2e9f0 >2013-12-04 09:30:38,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17912ed5 >2013-12-04 09:30:38,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 17912ed5 >2013-12-04 09:30:38,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45b76061 >2013-12-04 09:30:38,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af959e12, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b983f0c8}, log id: 45b76061 >2013-12-04 09:30:44,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 62bcfb62 >2013-12-04 09:30:44,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 62bcfb62 >2013-12-04 09:30:44,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1008094f >2013-12-04 09:30:44,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73260a21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84de004b}, log id: 1008094f >2013-12-04 09:30:49,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71479811 >2013-12-04 09:30:50,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 71479811 >2013-12-04 09:30:50,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5eb981cc >2013-12-04 09:30:50,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7e2fd04, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9eb5a79a}, log id: 5eb981cc >2013-12-04 09:30:51,068 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-04 09:30:51,068 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:30:51,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3401c551 >2013-12-04 09:30:51,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3401c551 >2013-12-04 09:30:55,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 47996d01 >2013-12-04 09:30:56,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 47996d01 >2013-12-04 09:30:56,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6603cc7e >2013-12-04 09:30:56,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a5daee1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba48b728}, log id: 6603cc7e >2013-12-04 09:31:01,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f8d4607 >2013-12-04 09:31:02,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1f8d4607 >2013-12-04 09:31:02,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 28cde843 >2013-12-04 09:31:02,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16751300, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c32d52a}, log id: 28cde843 >2013-12-04 09:31:07,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 191b6f36 >2013-12-04 09:31:07,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 191b6f36 >2013-12-04 09:31:07,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 37dd5b52 >2013-12-04 09:31:08,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f14b57c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b993ac3d}, log id: 37dd5b52 >2013-12-04 09:31:13,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4605be23 >2013-12-04 09:31:13,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4605be23 >2013-12-04 09:31:13,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5d939d50 >2013-12-04 09:31:13,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b7cbfb1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdcbbbc3}, log id: 5d939d50 >2013-12-04 09:31:19,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f8d3ca2 >2013-12-04 09:31:19,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f8d3ca2 >2013-12-04 09:31:19,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78a2c328 >2013-12-04 09:31:19,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ef36f95, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d35834a}, log id: 78a2c328 >2013-12-04 09:31:24,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 652d4bdc >2013-12-04 09:31:25,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 652d4bdc >2013-12-04 09:31:25,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2cf0de78 >2013-12-04 09:31:25,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba9b6e66, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b99e2186}, log id: 2cf0de78 >2013-12-04 09:31:30,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 163ed441 >2013-12-04 09:31:31,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 163ed441 >2013-12-04 09:31:31,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7bbd9f96 >2013-12-04 09:31:31,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b6d370f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62820b6d}, log id: 7bbd9f96 >2013-12-04 09:31:36,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1ad1165d >2013-12-04 09:31:37,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1ad1165d >2013-12-04 09:31:37,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e0b3723 >2013-12-04 09:31:37,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1493f4b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3930c025}, log id: 2e0b3723 >2013-12-04 09:31:42,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 548b4859 >2013-12-04 09:31:42,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 548b4859 >2013-12-04 09:31:42,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 72053132 >2013-12-04 09:31:43,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3ce7164, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@247824db}, log id: 72053132 >2013-12-04 09:31:48,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c30760b >2013-12-04 09:31:48,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5c30760b >2013-12-04 09:31:48,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 69d3608f >2013-12-04 09:31:48,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfba2fe4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c70f02f4}, log id: 69d3608f >2013-12-04 09:31:51,362 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-04 09:31:51,362 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:31:51,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a465b08 >2013-12-04 09:31:51,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1a465b08 >2013-12-04 09:31:54,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59cb2d42 >2013-12-04 09:31:54,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 59cb2d42 >2013-12-04 09:31:54,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 172f2f53 >2013-12-04 09:31:54,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d88f2931, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1604ebc6}, log id: 172f2f53 >2013-12-04 09:31:59,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46a150bd >2013-12-04 09:32:00,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 46a150bd >2013-12-04 09:32:00,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6eef239f >2013-12-04 09:32:00,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@239a8fc6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@719e0ad2}, log id: 6eef239f >2013-12-04 09:32:05,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1190c39a >2013-12-04 09:32:06,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1190c39a >2013-12-04 09:32:06,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40e8dcf2 >2013-12-04 09:32:06,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96e24d10, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@631eda97}, log id: 40e8dcf2 >2013-12-04 09:32:11,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e3f45bc >2013-12-04 09:32:12,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6e3f45bc >2013-12-04 09:32:12,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6694280d >2013-12-04 09:32:12,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43277beb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8340f2e}, log id: 6694280d >2013-12-04 09:32:17,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a4aef32 >2013-12-04 09:32:17,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4a4aef32 >2013-12-04 09:32:17,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6d2a2b49 >2013-12-04 09:32:18,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e88b4232, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94cad431}, log id: 6d2a2b49 >2013-12-04 09:32:23,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5e62aa4 >2013-12-04 09:32:23,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5e62aa4 >2013-12-04 09:32:23,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 616c83e8 >2013-12-04 09:32:23,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30619b4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61fd2f18}, log id: 616c83e8 >2013-12-04 09:32:28,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 52104243 >2013-12-04 09:32:29,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 52104243 >2013-12-04 09:32:29,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5bbd1845 >2013-12-04 09:32:29,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1b43bbe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a37b63a}, log id: 5bbd1845 >2013-12-04 09:32:34,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7edab67c >2013-12-04 09:32:35,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7edab67c >2013-12-04 09:32:35,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 61b53a >2013-12-04 09:32:35,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9590a90, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6335c81}, log id: 61b53a >2013-12-04 09:32:40,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1614ff66 >2013-12-04 09:32:41,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1614ff66 >2013-12-04 09:32:41,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5b265e2e >2013-12-04 09:32:41,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce6449b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@811f50ca}, log id: 5b265e2e >2013-12-04 09:32:46,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 56e017bd >2013-12-04 09:32:46,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 56e017bd >2013-12-04 09:32:46,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3201a3a9 >2013-12-04 09:32:47,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2320803, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2942f4}, log id: 3201a3a9 >2013-12-04 09:32:51,668 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-89) No up server in cluster >2013-12-04 09:32:51,668 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-89) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:32:51,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25dd431b >2013-12-04 09:32:51,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterTasksListVDSCommand, return: [], log id: 25dd431b >2013-12-04 09:32:52,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ff4b89f >2013-12-04 09:32:52,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3ff4b89f >2013-12-04 09:32:52,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21c87f8 >2013-12-04 09:32:53,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13e14eb9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af7848c7}, log id: 21c87f8 >2013-12-04 09:32:58,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f1c3ca3 >2013-12-04 09:32:58,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5f1c3ca3 >2013-12-04 09:32:58,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2f8bb59c >2013-12-04 09:32:58,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eea441a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69f50df7}, log id: 2f8bb59c >2013-12-04 09:33:03,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39780ba >2013-12-04 09:33:04,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 39780ba >2013-12-04 09:33:04,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36d1ef4f >2013-12-04 09:33:04,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d95c8834, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc7e3d85}, log id: 36d1ef4f >2013-12-04 09:33:09,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 56eb1d84 >2013-12-04 09:33:10,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 56eb1d84 >2013-12-04 09:33:10,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 76a7dd5f >2013-12-04 09:33:10,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7114d87c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6f0d89b}, log id: 76a7dd5f >2013-12-04 09:33:15,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 527c190e >2013-12-04 09:33:16,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 527c190e >2013-12-04 09:33:16,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1cc66c9d >2013-12-04 09:33:16,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@213700ad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79770349}, log id: 1cc66c9d >2013-12-04 09:33:21,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 48f6bc56 >2013-12-04 09:33:21,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 48f6bc56 >2013-12-04 09:33:21,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b024a8b >2013-12-04 09:33:22,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6450231c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe97e2c0}, log id: 6b024a8b >2013-12-04 09:33:27,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 76bd8997 >2013-12-04 09:33:27,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 76bd8997 >2013-12-04 09:33:27,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 233456f >2013-12-04 09:33:27,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9df0792a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90ba745f}, log id: 233456f >2013-12-04 09:33:33,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 68d11776 >2013-12-04 09:33:33,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 68d11776 >2013-12-04 09:33:33,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f68c41b >2013-12-04 09:33:33,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c01e6b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d07e33e7}, log id: 3f68c41b >2013-12-04 09:33:38,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 535d88e >2013-12-04 09:33:39,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 535d88e >2013-12-04 09:33:39,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4132acbb >2013-12-04 09:33:39,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6415508, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cc076cd}, log id: 4132acbb >2013-12-04 09:33:44,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 388344ca >2013-12-04 09:33:45,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 388344ca >2013-12-04 09:33:45,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6e3c343 >2013-12-04 09:33:45,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a36327d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9c539de}, log id: 6e3c343 >2013-12-04 09:33:50,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 82ca0d1 >2013-12-04 09:33:50,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 82ca0d1 >2013-12-04 09:33:50,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 670179e8 >2013-12-04 09:33:51,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0fb177d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b07ce30}, log id: 670179e8 >2013-12-04 09:33:51,976 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-04 09:33:52,002 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:33:52,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 28e76d5e >2013-12-04 09:33:52,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 28e76d5e >2013-12-04 09:33:56,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a61ec45 >2013-12-04 09:33:56,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a61ec45 >2013-12-04 09:33:56,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2612a62b >2013-12-04 09:33:57,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27ae4de7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb5f8abf}, log id: 2612a62b >2013-12-04 09:34:02,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1d21aec9 >2013-12-04 09:34:02,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d21aec9 >2013-12-04 09:34:02,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 54a6ad2b >2013-12-04 09:34:02,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4904dd0c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@352eabe0}, log id: 54a6ad2b >2013-12-04 09:34:07,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 46d380e8 >2013-12-04 09:34:08,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 46d380e8 >2013-12-04 09:34:08,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e7d2f62 >2013-12-04 09:34:08,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dafd58b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e66de888}, log id: 7e7d2f62 >2013-12-04 09:34:13,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30f1fffe >2013-12-04 09:34:14,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 30f1fffe >2013-12-04 09:34:14,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 390f5da >2013-12-04 09:34:14,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aba5f19f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b02c9b82}, log id: 390f5da >2013-12-04 09:34:19,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24f6b741 >2013-12-04 09:34:20,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 24f6b741 >2013-12-04 09:34:20,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1533d147 >2013-12-04 09:34:20,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61f312d2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7695738}, log id: 1533d147 >2013-12-04 09:34:25,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ad626ea >2013-12-04 09:34:25,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1ad626ea >2013-12-04 09:34:25,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a65a275 >2013-12-04 09:34:26,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4835af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72d628d4}, log id: 7a65a275 >2013-12-04 09:34:31,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6fc0e0ec >2013-12-04 09:34:31,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6fc0e0ec >2013-12-04 09:34:31,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4905e790 >2013-12-04 09:34:31,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c44bcc0e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1b3a402}, log id: 4905e790 >2013-12-04 09:34:33,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59cb2039 >2013-12-04 09:34:34,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4beee58e, log id: 59cb2039 >2013-12-04 09:34:34,091 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-72) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:34:34,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3120f494 >2013-12-04 09:34:34,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@65c83287, log id: 3120f494 >2013-12-04 09:34:37,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2c5d74f3 >2013-12-04 09:34:37,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c5d74f3 >2013-12-04 09:34:37,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1b0b521f >2013-12-04 09:34:37,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea1ab89, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fb497d2}, log id: 1b0b521f >2013-12-04 09:34:42,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3fde3b86 >2013-12-04 09:34:43,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fde3b86 >2013-12-04 09:34:43,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5285a1d9 >2013-12-04 09:34:43,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c12c1c06, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b54d32f0}, log id: 5285a1d9 >2013-12-04 09:34:48,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 22e8ac5b >2013-12-04 09:34:49,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 22e8ac5b >2013-12-04 09:34:49,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 424dd9c0 >2013-12-04 09:34:49,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7df2faf5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec148512}, log id: 424dd9c0 >2013-12-04 09:34:52,318 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [6d2d632b] No up server in cluster >2013-12-04 09:34:52,318 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [6d2d632b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:34:52,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7242a34a >2013-12-04 09:34:52,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7242a34a >2013-12-04 09:34:54,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 454b3f3d >2013-12-04 09:34:55,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 454b3f3d >2013-12-04 09:34:55,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 790df603 >2013-12-04 09:34:55,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1f7538e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d802bdb}, log id: 790df603 >2013-12-04 09:35:00,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53e7f15a >2013-12-04 09:35:00,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 53e7f15a >2013-12-04 09:35:00,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41f949da >2013-12-04 09:35:01,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ed46526, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf205f04}, log id: 41f949da >2013-12-04 09:35:06,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 53d7662f >2013-12-04 09:35:06,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 53d7662f >2013-12-04 09:35:06,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6f7af8da >2013-12-04 09:35:06,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d08f02a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36b0d8ec}, log id: 6f7af8da >2013-12-04 09:35:12,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 457befe3 >2013-12-04 09:35:12,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 457befe3 >2013-12-04 09:35:12,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 49e67552 >2013-12-04 09:35:12,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fce6afeb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@365148de}, log id: 49e67552 >2013-12-04 09:35:17,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3f1107a2 >2013-12-04 09:35:18,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f1107a2 >2013-12-04 09:35:18,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 545e7b9e >2013-12-04 09:35:18,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae09805, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34c8a65}, log id: 545e7b9e >2013-12-04 09:35:23,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 60bc44fb >2013-12-04 09:35:24,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 60bc44fb >2013-12-04 09:35:24,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 37aa9bbe >2013-12-04 09:35:24,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82ebd161, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38a09591}, log id: 37aa9bbe >2013-12-04 09:35:29,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 443dbda1 >2013-12-04 09:35:30,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 443dbda1 >2013-12-04 09:35:30,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 472a3c33 >2013-12-04 09:35:30,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15ca8e00, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df6e5fa0}, log id: 472a3c33 >2013-12-04 09:35:35,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 77f4503f >2013-12-04 09:35:35,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 77f4503f >2013-12-04 09:35:35,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 216b1a45 >2013-12-04 09:35:36,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42c70ad9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b00a9897}, log id: 216b1a45 >2013-12-04 09:35:41,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b0f548b >2013-12-04 09:35:41,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1b0f548b >2013-12-04 09:35:41,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: cb7555f >2013-12-04 09:35:41,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2cd8fc1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@409ca80c}, log id: cb7555f >2013-12-04 09:35:46,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 332173a1 >2013-12-04 09:35:47,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 332173a1 >2013-12-04 09:35:47,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 121f5db1 >2013-12-04 09:35:47,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbc99bf8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f88d1522}, log id: 121f5db1 >2013-12-04 09:35:52,623 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) No up server in cluster >2013-12-04 09:35:52,624 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:35:52,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45d0316d >2013-12-04 09:35:52,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1d88ead0 >2013-12-04 09:35:52,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, return: [], log id: 45d0316d >2013-12-04 09:35:53,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1d88ead0 >2013-12-04 09:35:53,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7d3bbfbc >2013-12-04 09:35:53,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4130ee13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbe64134}, log id: 7d3bbfbc >2013-12-04 09:35:58,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 391f4c73 >2013-12-04 09:35:59,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 391f4c73 >2013-12-04 09:35:59,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3763e44e >2013-12-04 09:35:59,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b70691, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad2ea53d}, log id: 3763e44e >2013-12-04 09:36:04,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6803aece >2013-12-04 09:36:04,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6803aece >2013-12-04 09:36:04,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28727cd2 >2013-12-04 09:36:05,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@526ea40e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4760179}, log id: 28727cd2 >2013-12-04 09:36:10,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36b44c56 >2013-12-04 09:36:10,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 36b44c56 >2013-12-04 09:36:10,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26d10a42 >2013-12-04 09:36:11,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8481560, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a614e570}, log id: 26d10a42 >2013-12-04 09:36:16,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3882ebaf >2013-12-04 09:36:16,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3882ebaf >2013-12-04 09:36:16,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ac22716 >2013-12-04 09:36:16,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b30ca16, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57fa3b5d}, log id: 2ac22716 >2013-12-04 09:36:21,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b5eafe >2013-12-04 09:36:22,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5b5eafe >2013-12-04 09:36:22,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54afd524 >2013-12-04 09:36:22,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e3a91cc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c61d8698}, log id: 54afd524 >2013-12-04 09:36:27,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 66d1285d >2013-12-04 09:36:28,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 66d1285d >2013-12-04 09:36:28,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 910c31e >2013-12-04 09:36:28,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f35e270c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d0a92de}, log id: 910c31e >2013-12-04 09:36:33,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4da0e638 >2013-12-04 09:36:34,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4da0e638 >2013-12-04 09:36:34,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b90d62a >2013-12-04 09:36:34,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26604d56, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b5c1fc3}, log id: 3b90d62a >2013-12-04 09:36:39,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 25676f15 >2013-12-04 09:36:39,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 25676f15 >2013-12-04 09:36:39,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 102aeea4 >2013-12-04 09:36:40,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@883e4f76, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d6c232d}, log id: 102aeea4 >2013-12-04 09:36:45,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 62ce36b >2013-12-04 09:36:45,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 62ce36b >2013-12-04 09:36:45,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 30c844bf >2013-12-04 09:36:45,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0c06c59, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5676f1e}, log id: 30c844bf >2013-12-04 09:36:51,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22bb9b00 >2013-12-04 09:36:51,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 22bb9b00 >2013-12-04 09:36:51,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69ef4bb5 >2013-12-04 09:36:51,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96ca0910, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c468b152}, log id: 69ef4bb5 >2013-12-04 09:36:52,935 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) No up server in cluster >2013-12-04 09:36:52,949 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:36:52,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2955759e >2013-12-04 09:36:53,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2955759e >2013-12-04 09:36:56,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7b81179e >2013-12-04 09:36:57,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7b81179e >2013-12-04 09:36:57,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 52e1b5c0 >2013-12-04 09:36:57,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ad6ea8e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47be3122}, log id: 52e1b5c0 >2013-12-04 09:37:02,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2563ca88 >2013-12-04 09:37:03,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2563ca88 >2013-12-04 09:37:03,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 577783ee >2013-12-04 09:37:03,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a402a921, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3256f4d2}, log id: 577783ee >2013-12-04 09:37:08,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b5c13cd >2013-12-04 09:37:09,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4b5c13cd >2013-12-04 09:37:09,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 649b7ad2 >2013-12-04 09:37:09,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df4809ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c54885db}, log id: 649b7ad2 >2013-12-04 09:37:14,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b9a6f7b >2013-12-04 09:37:14,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4b9a6f7b >2013-12-04 09:37:14,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2f75c41e >2013-12-04 09:37:15,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d6a59c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee31f895}, log id: 2f75c41e >2013-12-04 09:37:20,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 262c1a60 >2013-12-04 09:37:20,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 262c1a60 >2013-12-04 09:37:20,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 72bb65cf >2013-12-04 09:37:20,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@feb493bd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cbf80a4}, log id: 72bb65cf >2013-12-04 09:37:25,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6e4d3c01 >2013-12-04 09:37:26,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e4d3c01 >2013-12-04 09:37:26,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6d998c0d >2013-12-04 09:37:26,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b4f6d95, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bb3a782}, log id: 6d998c0d >2013-12-04 09:37:31,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6e62bdfa >2013-12-04 09:37:32,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6e62bdfa >2013-12-04 09:37:32,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5dd191d2 >2013-12-04 09:37:32,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bdda571, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ce4b3ec}, log id: 5dd191d2 >2013-12-04 09:37:37,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3619dc8e >2013-12-04 09:37:38,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3619dc8e >2013-12-04 09:37:38,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 496dc239 >2013-12-04 09:37:38,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22f29e21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da0d77b9}, log id: 496dc239 >2013-12-04 09:37:43,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1bf4c90c >2013-12-04 09:37:43,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bf4c90c >2013-12-04 09:37:43,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 456501ba >2013-12-04 09:37:44,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbf97065, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcdd0f7e}, log id: 456501ba >2013-12-04 09:37:49,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 28d88f0c >2013-12-04 09:37:49,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 28d88f0c >2013-12-04 09:37:49,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1d986fcd >2013-12-04 09:37:50,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9392832c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acab81bf}, log id: 1d986fcd >2013-12-04 09:37:53,249 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-04 09:37:53,271 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:37:53,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27bbfc22 >2013-12-04 09:37:53,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 27bbfc22 >2013-12-04 09:37:55,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3236ec5a >2013-12-04 09:37:55,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3236ec5a >2013-12-04 09:37:55,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 72d2d8fb >2013-12-04 09:37:55,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84ce617c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a73fb9d9}, log id: 72d2d8fb >2013-12-04 09:38:00,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 8fc36e2 >2013-12-04 09:38:01,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 8fc36e2 >2013-12-04 09:38:01,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43b909e5 >2013-12-04 09:38:01,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a84d0c57, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ccb2a0f}, log id: 43b909e5 >2013-12-04 09:38:06,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 14b7ec9c >2013-12-04 09:38:07,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 14b7ec9c >2013-12-04 09:38:07,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46d4103c >2013-12-04 09:38:07,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a6c78ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@212285fa}, log id: 46d4103c >2013-12-04 09:38:12,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a00ddbf >2013-12-04 09:38:13,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3a00ddbf >2013-12-04 09:38:13,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ad23cc4 >2013-12-04 09:38:13,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b55933df, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d2c1845}, log id: 1ad23cc4 >2013-12-04 09:38:18,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4b1a727a >2013-12-04 09:38:18,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b1a727a >2013-12-04 09:38:18,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4037d8d >2013-12-04 09:38:19,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f020aa2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@353ecd51}, log id: 4037d8d >2013-12-04 09:38:24,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 21baf39c >2013-12-04 09:38:24,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 21baf39c >2013-12-04 09:38:24,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a401450 >2013-12-04 09:38:25,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5e02bb1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a20bc32}, log id: 1a401450 >2013-12-04 09:38:30,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 453a932a >2013-12-04 09:38:30,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 453a932a >2013-12-04 09:38:30,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f6a79bf >2013-12-04 09:38:30,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4231fc91, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f94f0a4}, log id: 1f6a79bf >2013-12-04 09:38:35,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5fb750ed >2013-12-04 09:38:36,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5fb750ed >2013-12-04 09:38:36,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24dd8fbd >2013-12-04 09:38:36,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0d2ca86, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63721b14}, log id: 24dd8fbd >2013-12-04 09:38:36,889 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VMs/Templates Ovf. >2013-12-04 09:38:37,027 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-6) Start refreshing all users data >2013-12-04 09:38:41,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 160fcfb2 >2013-12-04 09:38:42,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 160fcfb2 >2013-12-04 09:38:42,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 137589be >2013-12-04 09:38:42,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e6bf520, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43627f3}, log id: 137589be >2013-12-04 09:38:47,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a03bd16 >2013-12-04 09:38:48,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a03bd16 >2013-12-04 09:38:48,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4743bbbd >2013-12-04 09:38:48,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bdd20d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@409a718d}, log id: 4743bbbd >2013-12-04 09:38:53,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c23648f >2013-12-04 09:38:53,590 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-04 09:38:53,598 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:38:53,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47922495 >2013-12-04 09:38:53,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 47922495 >2013-12-04 09:38:53,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1c23648f >2013-12-04 09:38:53,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1fd12f4e >2013-12-04 09:38:54,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6aaed3e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3222baeb}, log id: 1fd12f4e >2013-12-04 09:38:59,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 65e50ba6 >2013-12-04 09:38:59,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 65e50ba6 >2013-12-04 09:38:59,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c5dbdaa >2013-12-04 09:38:59,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87e9046b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27e07682}, log id: 6c5dbdaa >2013-12-04 09:39:05,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54cfb2e7 >2013-12-04 09:39:05,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 54cfb2e7 >2013-12-04 09:39:05,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6ac24cd6 >2013-12-04 09:39:05,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3fee932, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c93f81a}, log id: 6ac24cd6 >2013-12-04 09:39:10,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24c56788 >2013-12-04 09:39:11,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 24c56788 >2013-12-04 09:39:11,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 55b7622a >2013-12-04 09:39:11,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@923af9a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a380eb3}, log id: 55b7622a >2013-12-04 09:39:16,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1389669a >2013-12-04 09:39:17,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1389669a >2013-12-04 09:39:17,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f348e8d >2013-12-04 09:39:17,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d876e493, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b40e4e7}, log id: 6f348e8d >2013-12-04 09:39:22,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 135488d1 >2013-12-04 09:39:22,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 135488d1 >2013-12-04 09:39:22,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4e557eff >2013-12-04 09:39:23,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e232ade, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7860007}, log id: 4e557eff >2013-12-04 09:39:28,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2982ae56 >2013-12-04 09:39:28,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2982ae56 >2013-12-04 09:39:28,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 13d3e70b >2013-12-04 09:39:29,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54ab0342, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2533467}, log id: 13d3e70b >2013-12-04 09:39:34,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d5a795e >2013-12-04 09:39:34,424 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-98) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 09:39:34,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: d5a795e >2013-12-04 09:39:34,526 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-98) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 09:39:34,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61daa0fb >2013-12-04 09:39:34,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55e3c073, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@198a0cad}, log id: 61daa0fb >2013-12-04 09:39:34,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7df7d7b6 >2013-12-04 09:39:35,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@64a2caf2, log id: 7df7d7b6 >2013-12-04 09:39:35,105 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-98) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:39:35,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7bba097b >2013-12-04 09:39:35,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3db2013a, log id: 7bba097b >2013-12-04 09:39:39,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 802a3b7 >2013-12-04 09:39:40,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 802a3b7 >2013-12-04 09:39:40,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4a4cf50e >2013-12-04 09:39:40,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e4a4428, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc424673}, log id: 4a4cf50e >2013-12-04 09:39:45,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ba7cca4 >2013-12-04 09:39:46,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4ba7cca4 >2013-12-04 09:39:46,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 44450200 >2013-12-04 09:39:46,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a7c8c70, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a44ebf9b}, log id: 44450200 >2013-12-04 09:39:51,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3dcd519c >2013-12-04 09:39:52,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3dcd519c >2013-12-04 09:39:52,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4becb23f >2013-12-04 09:39:52,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d4ac337, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e9744fb}, log id: 4becb23f >2013-12-04 09:39:53,879 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) No up server in cluster >2013-12-04 09:39:53,880 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:39:53,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53ea0c84 >2013-12-04 09:39:54,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, return: [], log id: 53ea0c84 >2013-12-04 09:39:57,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b770dba >2013-12-04 09:39:57,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5b770dba >2013-12-04 09:39:57,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7796f93d >2013-12-04 09:39:58,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efefc26b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e395540c}, log id: 7796f93d >2013-12-04 09:40:03,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 770a47c5 >2013-12-04 09:40:03,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 770a47c5 >2013-12-04 09:40:03,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3f541b16 >2013-12-04 09:40:03,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3ca51a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85c71b2a}, log id: 3f541b16 >2013-12-04 09:40:08,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41a6aaa9 >2013-12-04 09:40:09,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 41a6aaa9 >2013-12-04 09:40:09,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 77b95a0 >2013-12-04 09:40:09,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25185c4d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2bc05cc}, log id: 77b95a0 >2013-12-04 09:40:14,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 632cb22d >2013-12-04 09:40:15,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 632cb22d >2013-12-04 09:40:15,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 72e7aaad >2013-12-04 09:40:15,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e2c8153, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ddedff4}, log id: 72e7aaad >2013-12-04 09:40:20,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 66eb27f7 >2013-12-04 09:40:21,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 66eb27f7 >2013-12-04 09:40:21,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1af176db >2013-12-04 09:40:21,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@617a9f0b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21aa2a05}, log id: 1af176db >2013-12-04 09:40:26,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 248460f >2013-12-04 09:40:27,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 248460f >2013-12-04 09:40:27,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 123dcd38 >2013-12-04 09:40:27,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23017090, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6a0b976}, log id: 123dcd38 >2013-12-04 09:40:32,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 21535cf0 >2013-12-04 09:40:32,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 21535cf0 >2013-12-04 09:40:32,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7002952d >2013-12-04 09:40:33,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd072a02, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72a4ff33}, log id: 7002952d >2013-12-04 09:40:38,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7fedc67 >2013-12-04 09:40:38,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7fedc67 >2013-12-04 09:40:38,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 462481e3 >2013-12-04 09:40:38,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b49f04f4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb2ffe28}, log id: 462481e3 >2013-12-04 09:40:43,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3112c385 >2013-12-04 09:40:44,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3112c385 >2013-12-04 09:40:44,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12f6cdca >2013-12-04 09:40:44,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@114c0f1b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b633b8e}, log id: 12f6cdca >2013-12-04 09:40:49,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1c7bb02c >2013-12-04 09:40:50,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1c7bb02c >2013-12-04 09:40:50,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1de78d86 >2013-12-04 09:40:50,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fefce6c7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfd67edb}, log id: 1de78d86 >2013-12-04 09:40:54,199 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) No up server in cluster >2013-12-04 09:40:54,200 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:40:54,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6fa78732 >2013-12-04 09:40:54,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6fa78732 >2013-12-04 09:40:55,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f8a7784 >2013-12-04 09:40:56,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: f8a7784 >2013-12-04 09:40:56,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7d122856 >2013-12-04 09:40:56,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@113c224e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed384edf}, log id: 7d122856 >2013-12-04 09:41:01,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 290e3ec1 >2013-12-04 09:41:01,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 290e3ec1 >2013-12-04 09:41:01,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 64c68e10 >2013-12-04 09:41:02,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38b510bf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33f19110}, log id: 64c68e10 >2013-12-04 09:41:07,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 305ad727 >2013-12-04 09:41:07,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 305ad727 >2013-12-04 09:41:07,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 9c9b211 >2013-12-04 09:41:08,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a143b01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2b7f5e6}, log id: 9c9b211 >2013-12-04 09:41:13,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b112133 >2013-12-04 09:41:13,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5b112133 >2013-12-04 09:41:13,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4144ee4b >2013-12-04 09:41:13,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5aab47f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ffeb9f1}, log id: 4144ee4b >2013-12-04 09:41:19,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 52e5793c >2013-12-04 09:41:19,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 52e5793c >2013-12-04 09:41:19,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47b06153 >2013-12-04 09:41:19,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54e75c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4db977e3}, log id: 47b06153 >2013-12-04 09:41:24,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 286e0737 >2013-12-04 09:41:25,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 286e0737 >2013-12-04 09:41:25,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: fcaf063 >2013-12-04 09:41:25,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a22e8770, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb920321}, log id: fcaf063 >2013-12-04 09:41:30,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 73f15cbb >2013-12-04 09:41:31,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 73f15cbb >2013-12-04 09:41:31,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 169d9890 >2013-12-04 09:41:31,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60b9922f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2726db10}, log id: 169d9890 >2013-12-04 09:41:36,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 71a42816 >2013-12-04 09:41:36,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 71a42816 >2013-12-04 09:41:36,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 788d5ecb >2013-12-04 09:41:37,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8bd31ae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@301d0c9a}, log id: 788d5ecb >2013-12-04 09:41:42,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57301a17 >2013-12-04 09:41:42,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 57301a17 >2013-12-04 09:41:42,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63102c29 >2013-12-04 09:41:43,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b68fa7a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@662c86df}, log id: 63102c29 >2013-12-04 09:41:48,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3054e13a >2013-12-04 09:41:48,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3054e13a >2013-12-04 09:41:48,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 517a78f5 >2013-12-04 09:41:48,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27757c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96242584}, log id: 517a78f5 >2013-12-04 09:41:53,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6faf274d >2013-12-04 09:41:54,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6faf274d >2013-12-04 09:41:54,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53daf303 >2013-12-04 09:41:54,508 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-04 09:41:54,509 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:41:54,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 69584207 >2013-12-04 09:41:54,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3d59197, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d456cf85}, log id: 53daf303 >2013-12-04 09:41:54,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: 69584207 >2013-12-04 09:41:59,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a4cdf9e >2013-12-04 09:42:00,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6a4cdf9e >2013-12-04 09:42:00,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 46d8c1b3 >2013-12-04 09:42:00,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f0853e0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51781c48}, log id: 46d8c1b3 >2013-12-04 09:42:05,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 135ab6cf >2013-12-04 09:42:06,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 135ab6cf >2013-12-04 09:42:06,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: f119485 >2013-12-04 09:42:06,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a210480, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d178a76}, log id: f119485 >2013-12-04 09:42:11,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e9022ac >2013-12-04 09:42:11,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3e9022ac >2013-12-04 09:42:11,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3fc49c91 >2013-12-04 09:42:12,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7368068d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8fe8070}, log id: 3fc49c91 >2013-12-04 09:42:17,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 526bddc3 >2013-12-04 09:42:17,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 526bddc3 >2013-12-04 09:42:17,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 49c6d8e2 >2013-12-04 09:42:18,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75d55cb7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aacc5c2b}, log id: 49c6d8e2 >2013-12-04 09:42:23,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2427aa9b >2013-12-04 09:42:23,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2427aa9b >2013-12-04 09:42:23,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4048c63d >2013-12-04 09:42:23,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a42bf51, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6d2948}, log id: 4048c63d >2013-12-04 09:42:28,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: f2a0b6c >2013-12-04 09:42:29,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: f2a0b6c >2013-12-04 09:42:29,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2df9077b >2013-12-04 09:42:29,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cb10d63, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d422be2}, log id: 2df9077b >2013-12-04 09:42:34,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4868baf4 >2013-12-04 09:42:35,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4868baf4 >2013-12-04 09:42:35,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7222c350 >2013-12-04 09:42:35,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b220445, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bddb9d2b}, log id: 7222c350 >2013-12-04 09:42:40,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14b2db41 >2013-12-04 09:42:41,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 14b2db41 >2013-12-04 09:42:41,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4af7ed9 >2013-12-04 09:42:41,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcab5335, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e87cc33}, log id: 4af7ed9 >2013-12-04 09:42:46,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3485ce61 >2013-12-04 09:42:46,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3485ce61 >2013-12-04 09:42:46,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 591b1f9e >2013-12-04 09:42:47,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e592d8ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29ad8ad5}, log id: 591b1f9e >2013-12-04 09:42:52,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 462e51c2 >2013-12-04 09:42:52,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 462e51c2 >2013-12-04 09:42:52,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: cda39b9 >2013-12-04 09:42:53,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb6fc34b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89fd524}, log id: cda39b9 >2013-12-04 09:42:54,820 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2013-12-04 09:42:54,839 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:42:54,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3fd49e9e >2013-12-04 09:42:55,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3fd49e9e >2013-12-04 09:42:58,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6b62b146 >2013-12-04 09:42:58,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6b62b146 >2013-12-04 09:42:58,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a87c845 >2013-12-04 09:42:58,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99034098, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a837a642}, log id: 7a87c845 >2013-12-04 09:43:03,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18a0a1cf >2013-12-04 09:43:04,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 18a0a1cf >2013-12-04 09:43:04,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6994fa2d >2013-12-04 09:43:04,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b8585aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65aa2992}, log id: 6994fa2d >2013-12-04 09:43:09,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 682b7381 >2013-12-04 09:43:10,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 682b7381 >2013-12-04 09:43:10,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ab7dfa9 >2013-12-04 09:43:10,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ea2b45b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@909a7e20}, log id: 2ab7dfa9 >2013-12-04 09:43:15,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7888b976 >2013-12-04 09:43:15,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7888b976 >2013-12-04 09:43:15,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5fc7ae93 >2013-12-04 09:43:16,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d32d72ae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffda1789}, log id: 5fc7ae93 >2013-12-04 09:43:21,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5561dff2 >2013-12-04 09:43:21,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5561dff2 >2013-12-04 09:43:21,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 72fd126d >2013-12-04 09:43:22,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@709ba0e8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84cc5735}, log id: 72fd126d >2013-12-04 09:43:27,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: cb04848 >2013-12-04 09:43:27,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: cb04848 >2013-12-04 09:43:27,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4dd8ec92 >2013-12-04 09:43:27,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73b6d587, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29e17fb8}, log id: 4dd8ec92 >2013-12-04 09:43:32,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79b5c90b >2013-12-04 09:43:33,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 79b5c90b >2013-12-04 09:43:33,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c18ede5 >2013-12-04 09:43:33,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2d6c537, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b824115}, log id: 3c18ede5 >2013-12-04 09:43:38,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b5f3854 >2013-12-04 09:43:39,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6b5f3854 >2013-12-04 09:43:39,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1148cb6e >2013-12-04 09:43:39,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68e54c0c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@519cefe2}, log id: 1148cb6e >2013-12-04 09:43:44,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 89fd13d >2013-12-04 09:43:45,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 89fd13d >2013-12-04 09:43:45,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 420427f1 >2013-12-04 09:43:45,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b284a711, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b94f6fb2}, log id: 420427f1 >2013-12-04 09:43:50,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 275dd4ae >2013-12-04 09:43:50,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 275dd4ae >2013-12-04 09:43:50,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: be4947e >2013-12-04 09:43:51,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d30c35f2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ddd33fc}, log id: be4947e >2013-12-04 09:43:55,153 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [6d2d632b] No up server in cluster >2013-12-04 09:43:55,154 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [6d2d632b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:43:55,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6cd8d529 >2013-12-04 09:43:55,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6cd8d529 >2013-12-04 09:43:56,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: f918ecb >2013-12-04 09:43:56,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: f918ecb >2013-12-04 09:43:56,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2849eed4 >2013-12-04 09:43:57,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4db4d2f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cd1af5d}, log id: 2849eed4 >2013-12-04 09:44:02,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3a487945 >2013-12-04 09:44:02,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3a487945 >2013-12-04 09:44:02,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5116990b >2013-12-04 09:44:02,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cb4a5f1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1816b65a}, log id: 5116990b >2013-12-04 09:44:07,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1b5e9e68 >2013-12-04 09:44:08,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b5e9e68 >2013-12-04 09:44:08,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 14f816e2 >2013-12-04 09:44:08,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc4dd860, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1614ff73}, log id: 14f816e2 >2013-12-04 09:44:13,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20ade7a8 >2013-12-04 09:44:14,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 20ade7a8 >2013-12-04 09:44:14,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7662fdb4 >2013-12-04 09:44:14,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4e8055b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e59e038}, log id: 7662fdb4 >2013-12-04 09:44:19,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 25c58e1d >2013-12-04 09:44:19,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 25c58e1d >2013-12-04 09:44:20,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6605f0e4 >2013-12-04 09:44:20,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4c5055c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c711fede}, log id: 6605f0e4 >2013-12-04 09:44:25,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1bf19d21 >2013-12-04 09:44:25,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1bf19d21 >2013-12-04 09:44:25,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c5a9bb2 >2013-12-04 09:44:26,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7781117, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22d6247d}, log id: 3c5a9bb2 >2013-12-04 09:44:31,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 26ca20ba >2013-12-04 09:44:31,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 26ca20ba >2013-12-04 09:44:31,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 619d02b >2013-12-04 09:44:31,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35a0c72, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21b57596}, log id: 619d02b >2013-12-04 09:44:35,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4b811c92 >2013-12-04 09:44:35,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@51b96f6, log id: 4b811c92 >2013-12-04 09:44:35,703 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-41) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:44:35,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5653f318 >2013-12-04 09:44:36,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1a5225df, log id: 5653f318 >2013-12-04 09:44:36,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 316f9c9a >2013-12-04 09:44:37,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 316f9c9a >2013-12-04 09:44:37,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4d4717e3 >2013-12-04 09:44:37,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93069608, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84e487fe}, log id: 4d4717e3 >2013-12-04 09:44:42,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e933ad2 >2013-12-04 09:44:43,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4e933ad2 >2013-12-04 09:44:43,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 599fa991 >2013-12-04 09:44:43,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2b010df, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f62e8649}, log id: 599fa991 >2013-12-04 09:44:48,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f88e57c >2013-12-04 09:44:49,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f88e57c >2013-12-04 09:44:49,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 549832cb >2013-12-04 09:44:49,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@866f5989, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdc9ea17}, log id: 549832cb >2013-12-04 09:44:54,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c7d9819 >2013-12-04 09:44:54,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4c7d9819 >2013-12-04 09:44:54,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 148fe9dc >2013-12-04 09:44:55,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@724b0bea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e33259a0}, log id: 148fe9dc >2013-12-04 09:44:55,458 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-04 09:44:55,476 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:44:55,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c6d0086 >2013-12-04 09:44:55,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2c6d0086 >2013-12-04 09:45:00,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 45278cf6 >2013-12-04 09:45:00,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 45278cf6 >2013-12-04 09:45:00,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3d006e10 >2013-12-04 09:45:01,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e126f639, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24459025}, log id: 3d006e10 >2013-12-04 09:45:06,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5954ef4b >2013-12-04 09:45:06,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5954ef4b >2013-12-04 09:45:06,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ed5ab6e >2013-12-04 09:45:06,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df068664, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0e0ea2a}, log id: 6ed5ab6e >2013-12-04 09:45:11,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 13ea8584 >2013-12-04 09:45:12,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 13ea8584 >2013-12-04 09:45:12,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4bb7cde9 >2013-12-04 09:45:12,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc87f944, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6eec5e23}, log id: 4bb7cde9 >2013-12-04 09:45:17,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b63163e >2013-12-04 09:45:18,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b63163e >2013-12-04 09:45:18,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24c23adb >2013-12-04 09:45:18,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6917e0ac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@646fdf68}, log id: 24c23adb >2013-12-04 09:45:23,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39ba31b6 >2013-12-04 09:45:24,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 39ba31b6 >2013-12-04 09:45:24,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 467a5d96 >2013-12-04 09:45:24,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea5304e4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@721a371e}, log id: 467a5d96 >2013-12-04 09:45:29,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 315e2a9 >2013-12-04 09:45:29,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 315e2a9 >2013-12-04 09:45:29,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 42c35caa >2013-12-04 09:45:30,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27f3eae8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@840e1b2e}, log id: 42c35caa >2013-12-04 09:45:35,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2ec6f2f4 >2013-12-04 09:45:35,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ec6f2f4 >2013-12-04 09:45:35,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 11176558 >2013-12-04 09:45:35,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1683a83b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85215aab}, log id: 11176558 >2013-12-04 09:45:40,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1f28e21 >2013-12-04 09:45:41,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1f28e21 >2013-12-04 09:45:41,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 48304371 >2013-12-04 09:45:41,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b289e71e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fd2e588}, log id: 48304371 >2013-12-04 09:45:46,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 541ebd31 >2013-12-04 09:45:47,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 541ebd31 >2013-12-04 09:45:47,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6dece95b >2013-12-04 09:45:47,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@939f847a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf43ed2a}, log id: 6dece95b >2013-12-04 09:45:52,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4b64fc73 >2013-12-04 09:45:53,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4b64fc73 >2013-12-04 09:45:53,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e4906b9 >2013-12-04 09:45:53,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1798a21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9690ddf}, log id: 2e4906b9 >2013-12-04 09:45:55,794 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-04 09:45:55,818 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:45:55,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f4f219a >2013-12-04 09:45:56,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f4f219a >2013-12-04 09:45:58,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: bf443d9 >2013-12-04 09:45:58,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: bf443d9 >2013-12-04 09:45:58,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10a67fd9 >2013-12-04 09:45:59,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8cffafa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87c3dbc0}, log id: 10a67fd9 >2013-12-04 09:46:04,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d1b25a4 >2013-12-04 09:46:04,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3d1b25a4 >2013-12-04 09:46:04,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4fb1bd49 >2013-12-04 09:46:05,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf4f1a1d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61217141}, log id: 4fb1bd49 >2013-12-04 09:46:10,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7b78591e >2013-12-04 09:46:10,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b78591e >2013-12-04 09:46:10,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: c6d234c >2013-12-04 09:46:10,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74bfa088, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d6a2ca6}, log id: c6d234c >2013-12-04 09:46:15,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3b52d732 >2013-12-04 09:46:16,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b52d732 >2013-12-04 09:46:16,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6fe02332 >2013-12-04 09:46:16,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fc47136, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca005e0f}, log id: 6fe02332 >2013-12-04 09:46:21,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 110cd132 >2013-12-04 09:46:22,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 110cd132 >2013-12-04 09:46:22,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5e971e2e >2013-12-04 09:46:22,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c44db088, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1247536d}, log id: 5e971e2e >2013-12-04 09:46:27,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24d13afb >2013-12-04 09:46:27,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 24d13afb >2013-12-04 09:46:28,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 481bec5e >2013-12-04 09:46:28,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5aaa082b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45e97ac3}, log id: 481bec5e >2013-12-04 09:46:33,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a1a3d35 >2013-12-04 09:46:33,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3a1a3d35 >2013-12-04 09:46:33,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 480322e1 >2013-12-04 09:46:34,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4988653, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69edd91e}, log id: 480322e1 >2013-12-04 09:46:39,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 273c9a31 >2013-12-04 09:46:39,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 273c9a31 >2013-12-04 09:46:39,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39a7f86c >2013-12-04 09:46:39,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9036ed99, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22171b53}, log id: 39a7f86c >2013-12-04 09:46:44,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1f5fedc9 >2013-12-04 09:46:45,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f5fedc9 >2013-12-04 09:46:45,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 145c2644 >2013-12-04 09:46:45,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36f733d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aef2655a}, log id: 145c2644 >2013-12-04 09:46:50,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 683da83a >2013-12-04 09:46:51,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 683da83a >2013-12-04 09:46:51,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 766a4087 >2013-12-04 09:46:51,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@717d20f2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13ee2eaf}, log id: 766a4087 >2013-12-04 09:46:56,119 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-04 09:46:56,119 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:46:56,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 49b8b353 >2013-12-04 09:46:56,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: 49b8b353 >2013-12-04 09:46:56,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 467eb6c1 >2013-12-04 09:46:57,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 467eb6c1 >2013-12-04 09:46:57,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c9500c >2013-12-04 09:46:57,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ab6c3aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd02f7e2}, log id: c9500c >2013-12-04 09:47:02,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3db9ac22 >2013-12-04 09:47:02,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3db9ac22 >2013-12-04 09:47:02,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e2d2224 >2013-12-04 09:47:03,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51774bf9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@201d39cc}, log id: 7e2d2224 >2013-12-04 09:47:08,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3afdb914 >2013-12-04 09:47:08,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3afdb914 >2013-12-04 09:47:08,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5bc1ac06 >2013-12-04 09:47:08,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63b0be22, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd56703c}, log id: 5bc1ac06 >2013-12-04 09:47:13,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3a3febc7 >2013-12-04 09:47:14,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a3febc7 >2013-12-04 09:47:14,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5dad9e49 >2013-12-04 09:47:14,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b7c62b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbff318}, log id: 5dad9e49 >2013-12-04 09:47:19,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7a9817df >2013-12-04 09:47:20,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a9817df >2013-12-04 09:47:20,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 605a363c >2013-12-04 09:47:20,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8af3350, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa4213c9}, log id: 605a363c >2013-12-04 09:47:25,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3429a5ff >2013-12-04 09:47:26,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3429a5ff >2013-12-04 09:47:26,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: a04ac74 >2013-12-04 09:47:26,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd319115, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@627fd9a4}, log id: a04ac74 >2013-12-04 09:47:31,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c6f791f >2013-12-04 09:47:31,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3c6f791f >2013-12-04 09:47:31,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 105e30cf >2013-12-04 09:47:32,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88200e58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7cf0529}, log id: 105e30cf >2013-12-04 09:47:37,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2f6755d3 >2013-12-04 09:47:37,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2f6755d3 >2013-12-04 09:47:37,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3a6d5063 >2013-12-04 09:47:37,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@851a680, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa6089fa}, log id: 3a6d5063 >2013-12-04 09:47:43,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2af3e8a7 >2013-12-04 09:47:43,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2af3e8a7 >2013-12-04 09:47:43,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11e2fbbe >2013-12-04 09:47:43,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c23abdd6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4747938}, log id: 11e2fbbe >2013-12-04 09:47:48,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ee808e5 >2013-12-04 09:47:49,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: ee808e5 >2013-12-04 09:47:49,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 235ceab1 >2013-12-04 09:47:49,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b948d2f5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6890cf2f}, log id: 235ceab1 >2013-12-04 09:47:54,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6920a76f >2013-12-04 09:47:55,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6920a76f >2013-12-04 09:47:55,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 155d2b3c >2013-12-04 09:47:55,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c215c842, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d9e50a4}, log id: 155d2b3c >2013-12-04 09:47:56,413 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) [e67de57] No up server in cluster >2013-12-04 09:47:56,430 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) [e67de57] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:47:56,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22fec1b7 >2013-12-04 09:47:56,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterTasksListVDSCommand, return: [], log id: 22fec1b7 >2013-12-04 09:48:00,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 49b86ea8 >2013-12-04 09:48:00,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 49b86ea8 >2013-12-04 09:48:00,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a6cc4c7 >2013-12-04 09:48:01,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbf3e295, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ee8f61d}, log id: a6cc4c7 >2013-12-04 09:48:06,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 38705cc3 >2013-12-04 09:48:06,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 38705cc3 >2013-12-04 09:48:06,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 55cb0774 >2013-12-04 09:48:07,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df225033, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8a6c61a}, log id: 55cb0774 >2013-12-04 09:48:12,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 342f68bc >2013-12-04 09:48:12,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 342f68bc >2013-12-04 09:48:12,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f3c8803 >2013-12-04 09:48:12,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8b1b247, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c0ae4f7}, log id: 7f3c8803 >2013-12-04 09:48:17,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 609f98af >2013-12-04 09:48:18,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 609f98af >2013-12-04 09:48:18,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d882d84 >2013-12-04 09:48:18,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@232e5a58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3aaad6f3}, log id: 3d882d84 >2013-12-04 09:48:23,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a0c8f5d >2013-12-04 09:48:24,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1a0c8f5d >2013-12-04 09:48:24,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d02ff1 >2013-12-04 09:48:24,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a1efc97, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8156808c}, log id: 1d02ff1 >2013-12-04 09:48:29,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59b8ccfa >2013-12-04 09:48:29,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 59b8ccfa >2013-12-04 09:48:29,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 770f1606 >2013-12-04 09:48:30,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11ce36b4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bea28d08}, log id: 770f1606 >2013-12-04 09:48:35,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e51cd0f >2013-12-04 09:48:35,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7e51cd0f >2013-12-04 09:48:35,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: eb4a270 >2013-12-04 09:48:36,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83306af8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20ade338}, log id: eb4a270 >2013-12-04 09:48:41,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41e70903 >2013-12-04 09:48:41,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 41e70903 >2013-12-04 09:48:41,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32b67666 >2013-12-04 09:48:41,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f427fcf0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@803cb6eb}, log id: 32b67666 >2013-12-04 09:48:46,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3494ddc0 >2013-12-04 09:48:47,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3494ddc0 >2013-12-04 09:48:47,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3809ecc7 >2013-12-04 09:48:47,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaa6ae21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44ee41e0}, log id: 3809ecc7 >2013-12-04 09:48:52,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 71100688 >2013-12-04 09:48:53,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 71100688 >2013-12-04 09:48:53,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1906a208 >2013-12-04 09:48:53,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68dcc06b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e5f4ef4}, log id: 1906a208 >2013-12-04 09:48:56,767 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) No up server in cluster >2013-12-04 09:48:56,768 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:48:56,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 464b60b4 >2013-12-04 09:48:57,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, return: [], log id: 464b60b4 >2013-12-04 09:48:58,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7053b6c9 >2013-12-04 09:48:59,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7053b6c9 >2013-12-04 09:48:59,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d976398 >2013-12-04 09:48:59,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b032a290, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@157ccc07}, log id: 6d976398 >2013-12-04 09:49:04,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 58dd6163 >2013-12-04 09:49:04,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 58dd6163 >2013-12-04 09:49:04,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c43ce12 >2013-12-04 09:49:05,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81119fbe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23628274}, log id: 6c43ce12 >2013-12-04 09:49:10,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 72813a2 >2013-12-04 09:49:10,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 72813a2 >2013-12-04 09:49:10,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 511faf63 >2013-12-04 09:49:11,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@319eec74, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef672947}, log id: 511faf63 >2013-12-04 09:49:16,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 21e3d08 >2013-12-04 09:49:16,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 21e3d08 >2013-12-04 09:49:16,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7346b909 >2013-12-04 09:49:16,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1709d28e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6897e4e4}, log id: 7346b909 >2013-12-04 09:49:21,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e4a779 >2013-12-04 09:49:22,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6e4a779 >2013-12-04 09:49:22,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e565b2 >2013-12-04 09:49:22,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@484eefc2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bede74fd}, log id: 5e565b2 >2013-12-04 09:49:27,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6c7177a >2013-12-04 09:49:28,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6c7177a >2013-12-04 09:49:28,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9b0c83c >2013-12-04 09:49:28,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c785f76, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92a90cd2}, log id: 9b0c83c >2013-12-04 09:49:33,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 356aa0ab >2013-12-04 09:49:34,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 356aa0ab >2013-12-04 09:49:34,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 558c8b29 >2013-12-04 09:49:34,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f909fd2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb244d21}, log id: 558c8b29 >2013-12-04 09:49:36,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36e5ca5e >2013-12-04 09:49:36,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@75975be9, log id: 36e5ca5e >2013-12-04 09:49:36,305 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-93) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:49:36,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24135a4f >2013-12-04 09:49:36,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@551d9218, log id: 24135a4f >2013-12-04 09:49:39,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27f6dbb7 >2013-12-04 09:49:39,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 27f6dbb7 >2013-12-04 09:49:39,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7603e2b >2013-12-04 09:49:40,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@274c02d0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c92c8c83}, log id: 7603e2b >2013-12-04 09:49:45,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5e47ebe9 >2013-12-04 09:49:45,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5e47ebe9 >2013-12-04 09:49:45,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4328e6a7 >2013-12-04 09:49:46,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b39c3379, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73bcadfd}, log id: 4328e6a7 >2013-12-04 09:49:51,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39bd8ffc >2013-12-04 09:49:51,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 39bd8ffc >2013-12-04 09:49:51,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3437ae97 >2013-12-04 09:49:51,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d782477d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef057d99}, log id: 3437ae97 >2013-12-04 09:49:56,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30da38bc >2013-12-04 09:49:57,079 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-04 09:49:57,082 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:49:57,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 302f47c9 >2013-12-04 09:49:57,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 302f47c9 >2013-12-04 09:49:57,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 30da38bc >2013-12-04 09:49:57,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 67b2637e >2013-12-04 09:49:57,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@100f1e31, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39147e58}, log id: 67b2637e >2013-12-04 09:50:02,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 328b5d27 >2013-12-04 09:50:03,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 328b5d27 >2013-12-04 09:50:03,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12874c81 >2013-12-04 09:50:03,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0fee1f7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df9755ef}, log id: 12874c81 >2013-12-04 09:50:08,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 393ae740 >2013-12-04 09:50:09,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 393ae740 >2013-12-04 09:50:09,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c986d95 >2013-12-04 09:50:09,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38233ce1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@407222a7}, log id: 5c986d95 >2013-12-04 09:50:14,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5fc67c56 >2013-12-04 09:50:14,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5fc67c56 >2013-12-04 09:50:14,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34b0310d >2013-12-04 09:50:15,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@956dcb91, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31dab583}, log id: 34b0310d >2013-12-04 09:50:20,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20374971 >2013-12-04 09:50:20,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 20374971 >2013-12-04 09:50:20,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 50d20a81 >2013-12-04 09:50:20,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cf746e0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8090b178}, log id: 50d20a81 >2013-12-04 09:50:25,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 204599b2 >2013-12-04 09:50:26,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 204599b2 >2013-12-04 09:50:26,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 531cb655 >2013-12-04 09:50:26,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64b258c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a37f66e}, log id: 531cb655 >2013-12-04 09:50:31,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2d8a1bef >2013-12-04 09:50:32,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d8a1bef >2013-12-04 09:50:32,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1426bd07 >2013-12-04 09:50:32,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a20f86c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9be6bdc6}, log id: 1426bd07 >2013-12-04 09:50:37,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ac1b4c7 >2013-12-04 09:50:38,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: ac1b4c7 >2013-12-04 09:50:38,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 58cec5c0 >2013-12-04 09:50:38,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f4ce8f7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd9bcf31}, log id: 58cec5c0 >2013-12-04 09:50:43,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6750f721 >2013-12-04 09:50:43,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6750f721 >2013-12-04 09:50:43,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 52f000aa >2013-12-04 09:50:44,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0d36b6e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1436c814}, log id: 52f000aa >2013-12-04 09:50:49,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e1863ab >2013-12-04 09:50:49,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1e1863ab >2013-12-04 09:50:49,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38b8e8c6 >2013-12-04 09:50:49,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67def21d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c85727f}, log id: 38b8e8c6 >2013-12-04 09:50:55,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 290c5c56 >2013-12-04 09:50:55,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 290c5c56 >2013-12-04 09:50:55,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3e380424 >2013-12-04 09:50:55,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@892f1bc7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90bfe7bb}, log id: 3e380424 >2013-12-04 09:50:57,372 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) No up server in cluster >2013-12-04 09:50:57,380 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:50:57,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5431d3a1 >2013-12-04 09:50:57,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5431d3a1 >2013-12-04 09:51:00,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4851da38 >2013-12-04 09:51:01,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4851da38 >2013-12-04 09:51:01,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 443aa28e >2013-12-04 09:51:01,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb1218cb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a344a7a}, log id: 443aa28e >2013-12-04 09:51:06,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1e87b4d0 >2013-12-04 09:51:07,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e87b4d0 >2013-12-04 09:51:07,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 76711057 >2013-12-04 09:51:07,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0275315, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eca75db4}, log id: 76711057 >2013-12-04 09:51:12,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 42ef2120 >2013-12-04 09:51:12,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 42ef2120 >2013-12-04 09:51:12,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 13c85526 >2013-12-04 09:51:13,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71812c41, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82109219}, log id: 13c85526 >2013-12-04 09:51:18,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70092e08 >2013-12-04 09:51:18,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 70092e08 >2013-12-04 09:51:18,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 31107fde >2013-12-04 09:51:19,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fab23179, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c729c341}, log id: 31107fde >2013-12-04 09:51:24,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 71459036 >2013-12-04 09:51:24,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 71459036 >2013-12-04 09:51:24,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1551ad39 >2013-12-04 09:51:24,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ba0dbde, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7afabaa1}, log id: 1551ad39 >2013-12-04 09:51:29,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 558027b6 >2013-12-04 09:51:30,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 558027b6 >2013-12-04 09:51:30,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5bad5023 >2013-12-04 09:51:30,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71961fa1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84388883}, log id: 5bad5023 >2013-12-04 09:51:35,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 33e70f4a >2013-12-04 09:51:36,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 33e70f4a >2013-12-04 09:51:36,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e979569 >2013-12-04 09:51:36,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7cbb5a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14b620f6}, log id: 1e979569 >2013-12-04 09:51:41,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66a4c3da >2013-12-04 09:51:42,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 66a4c3da >2013-12-04 09:51:42,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b1492d7 >2013-12-04 09:51:42,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fb987b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e58b01e}, log id: 5b1492d7 >2013-12-04 09:51:47,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 26f01e23 >2013-12-04 09:51:47,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 26f01e23 >2013-12-04 09:51:47,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21f91e7 >2013-12-04 09:51:48,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6db2979, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fdb4ac}, log id: 21f91e7 >2013-12-04 09:51:53,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b3f9b6f >2013-12-04 09:51:53,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b3f9b6f >2013-12-04 09:51:53,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 60a12220 >2013-12-04 09:51:53,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b402ff5a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72ace23c}, log id: 60a12220 >2013-12-04 09:51:57,687 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-04 09:51:57,688 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:51:57,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 51d1abf8 >2013-12-04 09:51:58,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: 51d1abf8 >2013-12-04 09:51:59,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a65068f >2013-12-04 09:51:59,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3a65068f >2013-12-04 09:51:59,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 168aacc6 >2013-12-04 09:51:59,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2120f64f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98c45568}, log id: 168aacc6 >2013-12-04 09:52:04,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1052de03 >2013-12-04 09:52:05,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1052de03 >2013-12-04 09:52:05,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 278d422d >2013-12-04 09:52:05,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7727343d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4410411}, log id: 278d422d >2013-12-04 09:52:10,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 15cdf52f >2013-12-04 09:52:11,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 15cdf52f >2013-12-04 09:52:11,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d52d210 >2013-12-04 09:52:11,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c30fbbf6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e16f06fa}, log id: 2d52d210 >2013-12-04 09:52:16,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4b9918d0 >2013-12-04 09:52:16,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4b9918d0 >2013-12-04 09:52:16,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20845c5f >2013-12-04 09:52:17,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@609b0703, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a10c3553}, log id: 20845c5f >2013-12-04 09:52:22,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 28a3fce8 >2013-12-04 09:52:22,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 28a3fce8 >2013-12-04 09:52:22,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f920224 >2013-12-04 09:52:23,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af8cac0e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca422be4}, log id: 7f920224 >2013-12-04 09:52:28,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67613d25 >2013-12-04 09:52:28,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 67613d25 >2013-12-04 09:52:28,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3fc69c0f >2013-12-04 09:52:28,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4cb7c5a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37d76a6f}, log id: 3fc69c0f >2013-12-04 09:52:33,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 224922b1 >2013-12-04 09:52:34,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 224922b1 >2013-12-04 09:52:34,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f29d02a >2013-12-04 09:52:34,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3faf8cd1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed16d64c}, log id: 7f29d02a >2013-12-04 09:52:39,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ee2604e >2013-12-04 09:52:40,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6ee2604e >2013-12-04 09:52:40,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 526b4045 >2013-12-04 09:52:40,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99d24f54, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@719c4202}, log id: 526b4045 >2013-12-04 09:52:45,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3330aa47 >2013-12-04 09:52:45,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3330aa47 >2013-12-04 09:52:45,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6b6fa3cc >2013-12-04 09:52:46,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@233ea9ad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43f134fb}, log id: 6b6fa3cc >2013-12-04 09:52:51,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 75c4120a >2013-12-04 09:52:51,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 75c4120a >2013-12-04 09:52:51,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5d4bd190 >2013-12-04 09:52:52,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@676afedc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@860e343e}, log id: 5d4bd190 >2013-12-04 09:52:57,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42d83c82 >2013-12-04 09:52:57,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 42d83c82 >2013-12-04 09:52:57,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 25ba909b >2013-12-04 09:52:57,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0ad9ac5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1b75d47}, log id: 25ba909b >2013-12-04 09:52:58,013 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) [451f957d] No up server in cluster >2013-12-04 09:52:58,015 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) [451f957d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:52:58,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c65c7b >2013-12-04 09:52:58,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3c65c7b >2013-12-04 09:53:02,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3cacbd7 >2013-12-04 09:53:03,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3cacbd7 >2013-12-04 09:53:03,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35c66c16 >2013-12-04 09:53:03,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf25144e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa9aa90b}, log id: 35c66c16 >2013-12-04 09:53:08,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 792a276f >2013-12-04 09:53:09,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 792a276f >2013-12-04 09:53:09,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 26d53138 >2013-12-04 09:53:09,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6e67afe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46fdafd0}, log id: 26d53138 >2013-12-04 09:53:14,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 267941f0 >2013-12-04 09:53:14,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 267941f0 >2013-12-04 09:53:15,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 49496b6e >2013-12-04 09:53:15,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@847c0244, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3907d9b}, log id: 49496b6e >2013-12-04 09:53:20,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 374f4e9 >2013-12-04 09:53:20,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 374f4e9 >2013-12-04 09:53:20,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 372a0965 >2013-12-04 09:53:21,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76ea1604, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3c2fa78}, log id: 372a0965 >2013-12-04 09:53:26,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2b14cf2d >2013-12-04 09:53:26,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b14cf2d >2013-12-04 09:53:26,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4fb19c8d >2013-12-04 09:53:26,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68864393, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@450cfa04}, log id: 4fb19c8d >2013-12-04 09:53:31,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32a06e0c >2013-12-04 09:53:32,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 32a06e0c >2013-12-04 09:53:32,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1dc4f184 >2013-12-04 09:53:32,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f0279ad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fcc98c8}, log id: 1dc4f184 >2013-12-04 09:53:37,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b02a88 >2013-12-04 09:53:38,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7b02a88 >2013-12-04 09:53:38,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 22b50931 >2013-12-04 09:53:38,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccc2915f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@790628d7}, log id: 22b50931 >2013-12-04 09:53:43,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d30a732 >2013-12-04 09:53:44,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2d30a732 >2013-12-04 09:53:44,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 223d72dc >2013-12-04 09:53:44,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf8efbe2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d93a109e}, log id: 223d72dc >2013-12-04 09:53:49,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6403367c >2013-12-04 09:53:49,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6403367c >2013-12-04 09:53:49,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b0e9cf3 >2013-12-04 09:53:50,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2998947, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d494bb1}, log id: 5b0e9cf3 >2013-12-04 09:53:55,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74fa478e >2013-12-04 09:53:55,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 74fa478e >2013-12-04 09:53:55,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1958db42 >2013-12-04 09:53:56,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a54db21e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4ceb2ed}, log id: 1958db42 >2013-12-04 09:53:58,317 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-83) No up server in cluster >2013-12-04 09:53:58,318 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-83) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:53:58,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: acec53a >2013-12-04 09:53:58,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterTasksListVDSCommand, return: [], log id: acec53a >2013-12-04 09:54:01,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6e7a9cf9 >2013-12-04 09:54:01,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6e7a9cf9 >2013-12-04 09:54:01,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 433fd387 >2013-12-04 09:54:01,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4a102cc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7acaa647}, log id: 433fd387 >2013-12-04 09:54:06,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d1d87ab >2013-12-04 09:54:07,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3d1d87ab >2013-12-04 09:54:07,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 138b4b9a >2013-12-04 09:54:07,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6abaa7a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb94dcc3}, log id: 138b4b9a >2013-12-04 09:54:12,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6c7d365 >2013-12-04 09:54:13,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6c7d365 >2013-12-04 09:54:13,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b8461d7 >2013-12-04 09:54:13,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97b22983, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e88e8ad6}, log id: 2b8461d7 >2013-12-04 09:54:18,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5a918af9 >2013-12-04 09:54:19,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5a918af9 >2013-12-04 09:54:19,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1c8e60bc >2013-12-04 09:54:19,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15684d50, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aeb4d70a}, log id: 1c8e60bc >2013-12-04 09:54:24,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ace316d >2013-12-04 09:54:24,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7ace316d >2013-12-04 09:54:24,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 726bb2f3 >2013-12-04 09:54:25,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@689ad3b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cab3ea0c}, log id: 726bb2f3 >2013-12-04 09:54:30,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4ee0af3a >2013-12-04 09:54:30,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4ee0af3a >2013-12-04 09:54:30,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b76a91b >2013-12-04 09:54:30,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f1f7112, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@218a12db}, log id: 6b76a91b >2013-12-04 09:54:36,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5acacc0d >2013-12-04 09:54:36,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5acacc0d >2013-12-04 09:54:36,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 495e9dbc >2013-12-04 09:54:36,618 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-25) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 09:54:36,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a648db7e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1785c77}, log id: 495e9dbc >2013-12-04 09:54:36,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 15899d6d >2013-12-04 09:54:37,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@70c1558a, log id: 15899d6d >2013-12-04 09:54:37,093 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-25) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:54:37,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24d710db >2013-12-04 09:54:37,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4111f5ef, log id: 24d710db >2013-12-04 09:54:41,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 71282ccf >2013-12-04 09:54:42,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 71282ccf >2013-12-04 09:54:42,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f2016a4 >2013-12-04 09:54:42,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4711edb5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4f1107f}, log id: 3f2016a4 >2013-12-04 09:54:47,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b750a52 >2013-12-04 09:54:48,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6b750a52 >2013-12-04 09:54:48,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 133edc49 >2013-12-04 09:54:48,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd604e55, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1949c6e}, log id: 133edc49 >2013-12-04 09:54:53,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 165f598a >2013-12-04 09:54:53,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 165f598a >2013-12-04 09:54:53,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4394ada8 >2013-12-04 09:54:54,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c412b6f3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b52f80b0}, log id: 4394ada8 >2013-12-04 09:54:58,629 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) [1f01d1f] No up server in cluster >2013-12-04 09:54:58,645 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) [1f01d1f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:54:58,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6566566a >2013-12-04 09:54:58,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6566566a >2013-12-04 09:54:59,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3ae7e76e >2013-12-04 09:54:59,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ae7e76e >2013-12-04 09:54:59,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5696272a >2013-12-04 09:55:00,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e087d06, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e703654}, log id: 5696272a >2013-12-04 09:55:05,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fdfc3d7 >2013-12-04 09:55:05,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2fdfc3d7 >2013-12-04 09:55:05,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 756aee8a >2013-12-04 09:55:05,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8f68128, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98806847}, log id: 756aee8a >2013-12-04 09:55:10,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 512dca18 >2013-12-04 09:55:11,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 512dca18 >2013-12-04 09:55:11,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53423b75 >2013-12-04 09:55:11,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55f3ff32, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f9b4466}, log id: 53423b75 >2013-12-04 09:55:16,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 433c9da >2013-12-04 09:55:17,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 433c9da >2013-12-04 09:55:17,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e992504 >2013-12-04 09:55:17,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60467328, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@289e0b10}, log id: e992504 >2013-12-04 09:55:22,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6cf45787 >2013-12-04 09:55:23,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6cf45787 >2013-12-04 09:55:23,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4dd08f06 >2013-12-04 09:55:23,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d46dec9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffcf1b81}, log id: 4dd08f06 >2013-12-04 09:55:28,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 37406cd6 >2013-12-04 09:55:28,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 37406cd6 >2013-12-04 09:55:28,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5f65420a >2013-12-04 09:55:29,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e4e0cee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c23c91a7}, log id: 5f65420a >2013-12-04 09:55:34,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5101cdde >2013-12-04 09:55:34,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5101cdde >2013-12-04 09:55:34,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b8e170e >2013-12-04 09:55:35,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2e56e5a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70d6005e}, log id: 2b8e170e >2013-12-04 09:55:40,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7cfd26e0 >2013-12-04 09:55:40,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7cfd26e0 >2013-12-04 09:55:40,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7493c87 >2013-12-04 09:55:40,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efd43933, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@911fc41d}, log id: 7493c87 >2013-12-04 09:55:45,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 13fbd99a >2013-12-04 09:55:46,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 13fbd99a >2013-12-04 09:55:46,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 420d56ba >2013-12-04 09:55:46,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81078c32, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58753c55}, log id: 420d56ba >2013-12-04 09:55:51,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 35627cda >2013-12-04 09:55:52,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 35627cda >2013-12-04 09:55:52,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 650a02d0 >2013-12-04 09:55:52,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@260fff2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0da40c6}, log id: 650a02d0 >2013-12-04 09:55:57,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2429986a >2013-12-04 09:55:58,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2429986a >2013-12-04 09:55:58,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d018641 >2013-12-04 09:55:58,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9285e2cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6574f0de}, log id: 6d018641 >2013-12-04 09:55:58,968 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-04 09:55:58,968 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:55:58,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a56ffb1 >2013-12-04 09:55:59,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1a56ffb1 >2013-12-04 09:56:03,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 557ba7d8 >2013-12-04 09:56:03,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 557ba7d8 >2013-12-04 09:56:03,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 439a601e >2013-12-04 09:56:04,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf8fed3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b61772e7}, log id: 439a601e >2013-12-04 09:56:09,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 25868f48 >2013-12-04 09:56:09,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 25868f48 >2013-12-04 09:56:09,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2f6d573e >2013-12-04 09:56:10,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@224bba10, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b955620f}, log id: 2f6d573e >2013-12-04 09:56:15,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 25a50a4b >2013-12-04 09:56:15,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 25a50a4b >2013-12-04 09:56:15,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 755a847f >2013-12-04 09:56:15,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc8e9352, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c2caeb8}, log id: 755a847f >2013-12-04 09:56:20,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6e797fd2 >2013-12-04 09:56:21,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e797fd2 >2013-12-04 09:56:21,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 287d37db >2013-12-04 09:56:21,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7db11a2a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdaa715c}, log id: 287d37db >2013-12-04 09:56:26,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 398fb61e >2013-12-04 09:56:27,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 398fb61e >2013-12-04 09:56:27,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 589d5930 >2013-12-04 09:56:27,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50e98b6a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7fa843c}, log id: 589d5930 >2013-12-04 09:56:32,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 68311382 >2013-12-04 09:56:33,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 68311382 >2013-12-04 09:56:33,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1abd9b1f >2013-12-04 09:56:33,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c60dba55, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95727e73}, log id: 1abd9b1f >2013-12-04 09:56:38,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19bc10dc >2013-12-04 09:56:38,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 19bc10dc >2013-12-04 09:56:38,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e44a09e >2013-12-04 09:56:39,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1aeabbcf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da24b495}, log id: 4e44a09e >2013-12-04 09:56:44,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6d2b8676 >2013-12-04 09:56:44,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d2b8676 >2013-12-04 09:56:44,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 520e5179 >2013-12-04 09:56:44,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2551add5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9b2bfb}, log id: 520e5179 >2013-12-04 09:56:49,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 620d07b6 >2013-12-04 09:56:50,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 620d07b6 >2013-12-04 09:56:50,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 62a1c1d2 >2013-12-04 09:56:50,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56087185, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1169086}, log id: 62a1c1d2 >2013-12-04 09:56:55,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 33d2c958 >2013-12-04 09:56:56,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 33d2c958 >2013-12-04 09:56:56,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 694cadc6 >2013-12-04 09:56:56,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8684547, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27b65688}, log id: 694cadc6 >2013-12-04 09:56:59,283 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) No up server in cluster >2013-12-04 09:56:59,302 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:56:59,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 127d2609 >2013-12-04 09:56:59,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterTasksListVDSCommand, return: [], log id: 127d2609 >2013-12-04 09:57:01,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d4b65db >2013-12-04 09:57:02,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3d4b65db >2013-12-04 09:57:02,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a0f2f4f >2013-12-04 09:57:02,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35476bad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6283f417}, log id: 7a0f2f4f >2013-12-04 09:57:07,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 755c8fad >2013-12-04 09:57:07,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 755c8fad >2013-12-04 09:57:07,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1bdad111 >2013-12-04 09:57:08,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@764d1159, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@484652e5}, log id: 1bdad111 >2013-12-04 09:57:13,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7eb3a794 >2013-12-04 09:57:13,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7eb3a794 >2013-12-04 09:57:13,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 399d2db7 >2013-12-04 09:57:14,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa519eb9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84907e0e}, log id: 399d2db7 >2013-12-04 09:57:19,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2d0946c0 >2013-12-04 09:57:19,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d0946c0 >2013-12-04 09:57:19,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 18cff922 >2013-12-04 09:57:19,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59045f20, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1537e39d}, log id: 18cff922 >2013-12-04 09:57:24,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ddcc192 >2013-12-04 09:57:25,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3ddcc192 >2013-12-04 09:57:25,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 32c0b658 >2013-12-04 09:57:25,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9a1dc83, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70418c43}, log id: 32c0b658 >2013-12-04 09:57:30,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 481c8e30 >2013-12-04 09:57:31,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 481c8e30 >2013-12-04 09:57:31,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a0cb30c >2013-12-04 09:57:31,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80dc3687, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89466934}, log id: 3a0cb30c >2013-12-04 09:57:36,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 56138412 >2013-12-04 09:57:37,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 56138412 >2013-12-04 09:57:37,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 455a1696 >2013-12-04 09:57:37,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6ae109a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abebba23}, log id: 455a1696 >2013-12-04 09:57:42,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20d52bac >2013-12-04 09:57:42,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 20d52bac >2013-12-04 09:57:42,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73d039ea >2013-12-04 09:57:43,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25948055, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf310af2}, log id: 73d039ea >2013-12-04 09:57:48,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 26757132 >2013-12-04 09:57:48,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 26757132 >2013-12-04 09:57:48,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63e110ad >2013-12-04 09:57:48,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4bfab0d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f17b3ef}, log id: 63e110ad >2013-12-04 09:57:54,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1f495abf >2013-12-04 09:57:54,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f495abf >2013-12-04 09:57:54,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 61e32754 >2013-12-04 09:57:54,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b502c56, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@924bea49}, log id: 61e32754 >2013-12-04 09:57:59,613 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) [4ca24342] No up server in cluster >2013-12-04 09:57:59,627 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) [4ca24342] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:57:59,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 23407072 >2013-12-04 09:57:59,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 62cc9e1d >2013-12-04 09:57:59,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterTasksListVDSCommand, return: [], log id: 23407072 >2013-12-04 09:58:00,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 62cc9e1d >2013-12-04 09:58:00,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 21048beb >2013-12-04 09:58:00,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9837aea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c56ed4f}, log id: 21048beb >2013-12-04 09:58:05,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d60785f >2013-12-04 09:58:06,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3d60785f >2013-12-04 09:58:06,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4653ba5e >2013-12-04 09:58:06,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7f27487, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b405f0}, log id: 4653ba5e >2013-12-04 09:58:11,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 519b1f7a >2013-12-04 09:58:11,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 519b1f7a >2013-12-04 09:58:12,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1e470e6c >2013-12-04 09:58:12,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57d00b7d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca442104}, log id: 1e470e6c >2013-12-04 09:58:17,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: fc3e197 >2013-12-04 09:58:17,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: fc3e197 >2013-12-04 09:58:17,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 26409170 >2013-12-04 09:58:18,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b675117, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c6ced90}, log id: 26409170 >2013-12-04 09:58:23,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e4e8aa3 >2013-12-04 09:58:23,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5e4e8aa3 >2013-12-04 09:58:23,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 77f00020 >2013-12-04 09:58:23,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8b3c3cb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@354ea5d8}, log id: 77f00020 >2013-12-04 09:58:29,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5474a41 >2013-12-04 09:58:29,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5474a41 >2013-12-04 09:58:29,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c630fb7 >2013-12-04 09:58:29,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d7655b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@298f88dd}, log id: 3c630fb7 >2013-12-04 09:58:34,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 37a9841a >2013-12-04 09:58:35,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 37a9841a >2013-12-04 09:58:35,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 346f3abb >2013-12-04 09:58:35,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@313df3fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@787b4a97}, log id: 346f3abb >2013-12-04 09:58:40,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 462ba7a6 >2013-12-04 09:58:41,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 462ba7a6 >2013-12-04 09:58:41,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 657a2d85 >2013-12-04 09:58:41,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4b5cb63, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d51aa4e}, log id: 657a2d85 >2013-12-04 09:58:46,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 200ee6a2 >2013-12-04 09:58:46,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 200ee6a2 >2013-12-04 09:58:46,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 218d78d6 >2013-12-04 09:58:47,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf4a6a09, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@903ff261}, log id: 218d78d6 >2013-12-04 09:58:52,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1461bb3f >2013-12-04 09:58:52,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1461bb3f >2013-12-04 09:58:52,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 28c4c8c7 >2013-12-04 09:58:53,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d176a3ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43a104d3}, log id: 28c4c8c7 >2013-12-04 09:58:58,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 463c5efe >2013-12-04 09:58:58,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 463c5efe >2013-12-04 09:58:58,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d360eb0 >2013-12-04 09:58:58,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bce52ac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44ac32d0}, log id: 3d360eb0 >2013-12-04 09:58:59,938 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-04 09:58:59,938 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:58:59,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27ae6fa3 >2013-12-04 09:59:00,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 27ae6fa3 >2013-12-04 09:59:03,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8d533d0 >2013-12-04 09:59:04,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 8d533d0 >2013-12-04 09:59:04,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3921a90b >2013-12-04 09:59:04,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22b146d1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39ba68b9}, log id: 3921a90b >2013-12-04 09:59:09,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 417bdcad >2013-12-04 09:59:10,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 417bdcad >2013-12-04 09:59:10,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 22e8467b >2013-12-04 09:59:10,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b720c9bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d8d6bad}, log id: 22e8467b >2013-12-04 09:59:15,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e89a37 >2013-12-04 09:59:16,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7e89a37 >2013-12-04 09:59:16,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d3b961b >2013-12-04 09:59:16,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37ea8098, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c0657ef}, log id: 4d3b961b >2013-12-04 09:59:21,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b11ce26 >2013-12-04 09:59:21,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b11ce26 >2013-12-04 09:59:21,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5d94f8ed >2013-12-04 09:59:22,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a7e46e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68b9b73a}, log id: 5d94f8ed >2013-12-04 09:59:27,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 505da8ca >2013-12-04 09:59:27,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 505da8ca >2013-12-04 09:59:27,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 51ff23d6 >2013-12-04 09:59:27,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61577c6d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53f42a30}, log id: 51ff23d6 >2013-12-04 09:59:32,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7a3e24e7 >2013-12-04 09:59:33,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a3e24e7 >2013-12-04 09:59:33,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 482fcb6b >2013-12-04 09:59:33,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f4d8a19, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61676c44}, log id: 482fcb6b >2013-12-04 09:59:37,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 35b677f >2013-12-04 09:59:37,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4c369255, log id: 35b677f >2013-12-04 09:59:37,680 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-35) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 09:59:37,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12c1318a >2013-12-04 09:59:37,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@795b7fe2, log id: 12c1318a >2013-12-04 09:59:38,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5a9fbfd3 >2013-12-04 09:59:39,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a9fbfd3 >2013-12-04 09:59:39,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4f36d55c >2013-12-04 09:59:39,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec2a5538, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49075974}, log id: 4f36d55c >2013-12-04 09:59:44,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5d1cb6d3 >2013-12-04 09:59:45,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5d1cb6d3 >2013-12-04 09:59:45,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 44d174db >2013-12-04 09:59:45,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9f5fc5f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbd2149c}, log id: 44d174db >2013-12-04 09:59:50,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c450345 >2013-12-04 09:59:50,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6c450345 >2013-12-04 09:59:50,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ccfbf8d >2013-12-04 09:59:51,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@974189dc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d7dbfdc}, log id: 1ccfbf8d >2013-12-04 09:59:56,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 621907 >2013-12-04 09:59:56,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 621907 >2013-12-04 09:59:56,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 64ba7f6d >2013-12-04 09:59:57,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f19e714, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4b50dab}, log id: 64ba7f6d >2013-12-04 10:00:00,248 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-04 10:00:00,249 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:00:00,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4752d16e >2013-12-04 10:00:00,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4752d16e >2013-12-04 10:00:02,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: a01e27f >2013-12-04 10:00:02,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: a01e27f >2013-12-04 10:00:02,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 41fbf6be >2013-12-04 10:00:02,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fc868d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da5dd9f8}, log id: 41fbf6be >2013-12-04 10:00:07,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 11e964de >2013-12-04 10:00:08,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 11e964de >2013-12-04 10:00:08,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 435ceddb >2013-12-04 10:00:08,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1201d43, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbb01857}, log id: 435ceddb >2013-12-04 10:00:13,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2a67c7c0 >2013-12-04 10:00:14,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2a67c7c0 >2013-12-04 10:00:14,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4d428be9 >2013-12-04 10:00:14,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@805bdf5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3ce74c8}, log id: 4d428be9 >2013-12-04 10:00:19,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 700a3d05 >2013-12-04 10:00:20,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 700a3d05 >2013-12-04 10:00:20,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3705a1ff >2013-12-04 10:00:20,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@328b4d70, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b924f88}, log id: 3705a1ff >2013-12-04 10:00:25,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 49c99ae0 >2013-12-04 10:00:25,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 49c99ae0 >2013-12-04 10:00:25,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 148e4b97 >2013-12-04 10:00:26,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69bc3de5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2407d8b7}, log id: 148e4b97 >2013-12-04 10:00:31,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 49420103 >2013-12-04 10:00:31,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 49420103 >2013-12-04 10:00:31,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 620a7f3f >2013-12-04 10:00:32,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2da91702, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@334bf432}, log id: 620a7f3f >2013-12-04 10:00:37,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d603318 >2013-12-04 10:00:37,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1d603318 >2013-12-04 10:00:37,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 687c1c8c >2013-12-04 10:00:37,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7b7a5e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5031e60}, log id: 687c1c8c >2013-12-04 10:00:42,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4350cfab >2013-12-04 10:00:43,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4350cfab >2013-12-04 10:00:43,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 31a585c3 >2013-12-04 10:00:43,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a2f996a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@361b4c62}, log id: 31a585c3 >2013-12-04 10:00:48,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 18bb73ba >2013-12-04 10:00:49,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 18bb73ba >2013-12-04 10:00:49,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 14553863 >2013-12-04 10:00:49,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f7bd9f7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6fe1af}, log id: 14553863 >2013-12-04 10:00:54,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 16d36410 >2013-12-04 10:00:54,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 16d36410 >2013-12-04 10:00:54,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2c175736 >2013-12-04 10:00:55,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb9db3d4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89bb50aa}, log id: 2c175736 >2013-12-04 10:01:00,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69750474 >2013-12-04 10:01:00,560 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2013-12-04 10:01:00,561 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:01:00,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: d265d3c >2013-12-04 10:01:00,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 69750474 >2013-12-04 10:01:00,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c6811b4 >2013-12-04 10:01:00,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: d265d3c >2013-12-04 10:01:01,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ae7406, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91a8e8e8}, log id: 2c6811b4 >2013-12-04 10:01:06,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29e78b5b >2013-12-04 10:01:06,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 29e78b5b >2013-12-04 10:01:06,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a6dac1b >2013-12-04 10:01:06,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df59c720, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d03ea527}, log id: 6a6dac1b >2013-12-04 10:01:12,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 23097fa3 >2013-12-04 10:01:12,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 23097fa3 >2013-12-04 10:01:12,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7429de18 >2013-12-04 10:01:12,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2bf3079, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7a27972}, log id: 7429de18 >2013-12-04 10:01:17,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5cc3043c >2013-12-04 10:01:18,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5cc3043c >2013-12-04 10:01:18,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 8deab58 >2013-12-04 10:01:18,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e17045fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e2f3fbe}, log id: 8deab58 >2013-12-04 10:01:23,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 27cef095 >2013-12-04 10:01:24,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 27cef095 >2013-12-04 10:01:24,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 71418e3e >2013-12-04 10:01:24,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24df3046, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73b1d600}, log id: 71418e3e >2013-12-04 10:01:29,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ed0f61 >2013-12-04 10:01:29,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: ed0f61 >2013-12-04 10:01:30,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3401503 >2013-12-04 10:01:30,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71098a89, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ecc080d8}, log id: 3401503 >2013-12-04 10:01:35,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 10ece9ee >2013-12-04 10:01:35,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 10ece9ee >2013-12-04 10:01:35,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 566b0aae >2013-12-04 10:01:36,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65d05773, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@958d81e3}, log id: 566b0aae >2013-12-04 10:01:41,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7d842a4 >2013-12-04 10:01:41,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d842a4 >2013-12-04 10:01:41,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 39285875 >2013-12-04 10:01:41,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6c7bc0f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d8b82f}, log id: 39285875 >2013-12-04 10:01:46,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 41366ddb >2013-12-04 10:01:47,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 41366ddb >2013-12-04 10:01:47,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6b96165d >2013-12-04 10:01:47,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3e471a0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73902532}, log id: 6b96165d >2013-12-04 10:01:52,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5726da95 >2013-12-04 10:01:53,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5726da95 >2013-12-04 10:01:53,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 45aebad5 >2013-12-04 10:01:53,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ad99e84, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b90bee21}, log id: 45aebad5 >2013-12-04 10:01:58,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3baa3fb2 >2013-12-04 10:01:59,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3baa3fb2 >2013-12-04 10:01:59,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 8bf9f70 >2013-12-04 10:01:59,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a301ecf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19e94856}, log id: 8bf9f70 >2013-12-04 10:02:00,874 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-04 10:02:00,880 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:02:00,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 56bb8555 >2013-12-04 10:02:01,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 56bb8555 >2013-12-04 10:02:04,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 351c7d30 >2013-12-04 10:02:04,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 351c7d30 >2013-12-04 10:02:04,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 249435c5 >2013-12-04 10:02:05,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6dc2b31, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bc458c4}, log id: 249435c5 >2013-12-04 10:02:10,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e909acc >2013-12-04 10:02:10,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: e909acc >2013-12-04 10:02:10,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 101bc7b7 >2013-12-04 10:02:10,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2a59d2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3207ce5}, log id: 101bc7b7 >2013-12-04 10:02:15,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5371a586 >2013-12-04 10:02:16,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5371a586 >2013-12-04 10:02:16,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 35cf0a16 >2013-12-04 10:02:16,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b083ebb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de0073ab}, log id: 35cf0a16 >2013-12-04 10:02:21,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a613982 >2013-12-04 10:02:22,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1a613982 >2013-12-04 10:02:22,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41aec52b >2013-12-04 10:02:22,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f33d09e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd71babe}, log id: 41aec52b >2013-12-04 10:02:27,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5cecf686 >2013-12-04 10:02:28,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5cecf686 >2013-12-04 10:02:28,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54041e2e >2013-12-04 10:02:28,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98428d0a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f392ae87}, log id: 54041e2e >2013-12-04 10:02:33,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10175988 >2013-12-04 10:02:33,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 10175988 >2013-12-04 10:02:33,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 47aef390 >2013-12-04 10:02:34,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f34917b0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55a7a9c1}, log id: 47aef390 >2013-12-04 10:02:39,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38844426 >2013-12-04 10:02:39,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 38844426 >2013-12-04 10:02:39,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d6cf39c >2013-12-04 10:02:40,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f640846, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ac5ef90}, log id: d6cf39c >2013-12-04 10:02:45,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2cf705a4 >2013-12-04 10:02:45,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2cf705a4 >2013-12-04 10:02:45,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75a309f6 >2013-12-04 10:02:45,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22661d2d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fce09f11}, log id: 75a309f6 >2013-12-04 10:02:50,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10609d9e >2013-12-04 10:02:51,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 10609d9e >2013-12-04 10:02:51,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3337cfe4 >2013-12-04 10:02:51,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe18cd19, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d90b6a9}, log id: 3337cfe4 >2013-12-04 10:02:56,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4815ec2e >2013-12-04 10:02:57,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4815ec2e >2013-12-04 10:02:57,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b9fccdb >2013-12-04 10:02:57,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bace9879, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e6843d6}, log id: 5b9fccdb >2013-12-04 10:03:01,198 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) [6dd5dead] No up server in cluster >2013-12-04 10:03:01,221 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) [6dd5dead] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:03:01,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67053873 >2013-12-04 10:03:01,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterTasksListVDSCommand, return: [], log id: 67053873 >2013-12-04 10:03:02,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 517e0a29 >2013-12-04 10:03:03,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 517e0a29 >2013-12-04 10:03:03,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b6f9639 >2013-12-04 10:03:03,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19219e92, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4224975a}, log id: 6b6f9639 >2013-12-04 10:03:08,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 368edeb3 >2013-12-04 10:03:08,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 368edeb3 >2013-12-04 10:03:08,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c41b841 >2013-12-04 10:03:09,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc749b08, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5c98d7e}, log id: 1c41b841 >2013-12-04 10:03:14,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2a06b43 >2013-12-04 10:03:14,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2a06b43 >2013-12-04 10:03:14,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69c6d92d >2013-12-04 10:03:14,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb3aa055, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac350c97}, log id: 69c6d92d >2013-12-04 10:03:19,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 64b13235 >2013-12-04 10:03:20,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 64b13235 >2013-12-04 10:03:20,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 199697ca >2013-12-04 10:03:20,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3170bbe2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b532652}, log id: 199697ca >2013-12-04 10:03:25,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70a1acc0 >2013-12-04 10:03:26,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 70a1acc0 >2013-12-04 10:03:26,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 27bf45c6 >2013-12-04 10:03:26,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85d3a7e1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a616fc4c}, log id: 27bf45c6 >2013-12-04 10:03:31,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d0ee44b >2013-12-04 10:03:32,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: d0ee44b >2013-12-04 10:03:32,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29f97a16 >2013-12-04 10:03:32,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b130ad09, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3760e815}, log id: 29f97a16 >2013-12-04 10:03:37,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 354386f9 >2013-12-04 10:03:37,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 354386f9 >2013-12-04 10:03:37,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 230679b0 >2013-12-04 10:03:38,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba55a1a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41fd7f32}, log id: 230679b0 >2013-12-04 10:03:43,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79507d79 >2013-12-04 10:03:43,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 79507d79 >2013-12-04 10:03:43,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63ec231 >2013-12-04 10:03:43,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41823b3e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79a2e9b}, log id: 63ec231 >2013-12-04 10:03:49,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6bfa6919 >2013-12-04 10:03:49,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6bfa6919 >2013-12-04 10:03:49,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 49063211 >2013-12-04 10:03:49,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14464614, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@febc40c1}, log id: 49063211 >2013-12-04 10:03:54,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5edd600b >2013-12-04 10:03:55,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5edd600b >2013-12-04 10:03:55,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6577f08b >2013-12-04 10:03:55,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c083467b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7a95b5b}, log id: 6577f08b >2013-12-04 10:04:00,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 160aba69 >2013-12-04 10:04:01,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 160aba69 >2013-12-04 10:04:01,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24289736 >2013-12-04 10:04:01,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@760ddc50, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f79f522}, log id: 24289736 >2013-12-04 10:04:01,541 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-04 10:04:01,550 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:04:01,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ef241d9 >2013-12-04 10:04:01,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: ef241d9 >2013-12-04 10:04:06,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5070697b >2013-12-04 10:04:07,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5070697b >2013-12-04 10:04:07,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 660a72b8 >2013-12-04 10:04:07,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb330df6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3501cbeb}, log id: 660a72b8 >2013-12-04 10:04:12,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 20f32205 >2013-12-04 10:04:12,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 20f32205 >2013-12-04 10:04:12,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2c10676a >2013-12-04 10:04:13,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6d9a6be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcc37ed}, log id: 2c10676a >2013-12-04 10:04:18,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 43afec34 >2013-12-04 10:04:18,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 43afec34 >2013-12-04 10:04:18,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40f36c93 >2013-12-04 10:04:18,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38924f30, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f7fb356}, log id: 40f36c93 >2013-12-04 10:04:23,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4d298071 >2013-12-04 10:04:24,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4d298071 >2013-12-04 10:04:24,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b854015 >2013-12-04 10:04:24,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea41a3d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcfc0295}, log id: 4b854015 >2013-12-04 10:04:29,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c8238b5 >2013-12-04 10:04:30,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3c8238b5 >2013-12-04 10:04:30,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1d579f10 >2013-12-04 10:04:30,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de3402a5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f65f6260}, log id: 1d579f10 >2013-12-04 10:04:35,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 453677e0 >2013-12-04 10:04:36,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 453677e0 >2013-12-04 10:04:36,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2f66052 >2013-12-04 10:04:36,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae9b6ef2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb239c6a}, log id: 2f66052 >2013-12-04 10:04:37,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 8e8c6d0 >2013-12-04 10:04:38,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3ee2c520, log id: 8e8c6d0 >2013-12-04 10:04:38,271 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-42) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:04:38,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 19fbd821 >2013-12-04 10:04:38,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1438d035, log id: 19fbd821 >2013-12-04 10:04:41,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6cb908ff >2013-12-04 10:04:41,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cb908ff >2013-12-04 10:04:41,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 533260cf >2013-12-04 10:04:42,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acdd763d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5edb2482}, log id: 533260cf >2013-12-04 10:04:47,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22e5d1d1 >2013-12-04 10:04:47,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 22e5d1d1 >2013-12-04 10:04:47,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 68eee33e >2013-12-04 10:04:48,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61e52e04, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7093ec6c}, log id: 68eee33e >2013-12-04 10:04:53,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 77449834 >2013-12-04 10:04:53,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 77449834 >2013-12-04 10:04:53,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 438e55c1 >2013-12-04 10:04:53,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d260748, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cf200fc}, log id: 438e55c1 >2013-12-04 10:04:59,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68758f64 >2013-12-04 10:04:59,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 68758f64 >2013-12-04 10:04:59,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7c38badf >2013-12-04 10:04:59,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec714660, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fcac525}, log id: 7c38badf >2013-12-04 10:05:01,851 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-04 10:05:01,858 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:05:01,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d3937fe >2013-12-04 10:05:02,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2d3937fe >2013-12-04 10:05:04,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 95da237 >2013-12-04 10:05:05,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 95da237 >2013-12-04 10:05:05,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 791d2c6c >2013-12-04 10:05:05,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfb1ea6f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65a4be45}, log id: 791d2c6c >2013-12-04 10:05:10,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4fbc4e02 >2013-12-04 10:05:11,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4fbc4e02 >2013-12-04 10:05:11,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 236dd853 >2013-12-04 10:05:11,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c29a3773, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8617ef37}, log id: 236dd853 >2013-12-04 10:05:16,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 73265d09 >2013-12-04 10:05:16,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 73265d09 >2013-12-04 10:05:16,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d99bf7b >2013-12-04 10:05:17,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9187ff8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75a2fb01}, log id: 7d99bf7b >2013-12-04 10:05:22,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21c0d377 >2013-12-04 10:05:22,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 21c0d377 >2013-12-04 10:05:22,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34e7c7ab >2013-12-04 10:05:23,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88f2f43c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cac3b5ab}, log id: 34e7c7ab >2013-12-04 10:05:28,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b01a498 >2013-12-04 10:05:28,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: b01a498 >2013-12-04 10:05:28,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2185b04a >2013-12-04 10:05:28,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa241fef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a4cd2bc}, log id: 2185b04a >2013-12-04 10:05:33,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 340086e0 >2013-12-04 10:05:34,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 340086e0 >2013-12-04 10:05:34,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5b2e5058 >2013-12-04 10:05:34,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d77933ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2d2da07}, log id: 5b2e5058 >2013-12-04 10:05:39,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a7b2aa7 >2013-12-04 10:05:40,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1a7b2aa7 >2013-12-04 10:05:40,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 31fac045 >2013-12-04 10:05:40,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b006259, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88170370}, log id: 31fac045 >2013-12-04 10:05:45,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7675816b >2013-12-04 10:05:46,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7675816b >2013-12-04 10:05:46,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6dd8655e >2013-12-04 10:05:46,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@691dd323, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e1c60f3}, log id: 6dd8655e >2013-12-04 10:05:51,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 18356129 >2013-12-04 10:05:51,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 18356129 >2013-12-04 10:05:51,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3c7afb94 >2013-12-04 10:05:52,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e60c7cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba4dd2b8}, log id: 3c7afb94 >2013-12-04 10:05:57,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 65fd319a >2013-12-04 10:05:57,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 65fd319a >2013-12-04 10:05:57,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39ac8890 >2013-12-04 10:05:58,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2b736d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a6ae159}, log id: 39ac8890 >2013-12-04 10:06:02,169 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) No up server in cluster >2013-12-04 10:06:02,183 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:06:02,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 33e9e5a0 >2013-12-04 10:06:02,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterTasksListVDSCommand, return: [], log id: 33e9e5a0 >2013-12-04 10:06:03,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 781c8d7b >2013-12-04 10:06:03,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 781c8d7b >2013-12-04 10:06:03,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7ce6ec89 >2013-12-04 10:06:03,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dec6e6d4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a61f750}, log id: 7ce6ec89 >2013-12-04 10:06:08,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 76c7b344 >2013-12-04 10:06:09,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 76c7b344 >2013-12-04 10:06:09,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 34dbb1b >2013-12-04 10:06:09,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25d43c3a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d88813ce}, log id: 34dbb1b >2013-12-04 10:06:14,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1b8f604e >2013-12-04 10:06:15,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1b8f604e >2013-12-04 10:06:15,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a9d7075 >2013-12-04 10:06:15,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aba7c7bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8426d2dd}, log id: 4a9d7075 >2013-12-04 10:06:20,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 33b25428 >2013-12-04 10:06:21,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 33b25428 >2013-12-04 10:06:21,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 8b4adc2 >2013-12-04 10:06:21,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c69a8c6b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4894871}, log id: 8b4adc2 >2013-12-04 10:06:26,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 484ea501 >2013-12-04 10:06:26,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 484ea501 >2013-12-04 10:06:26,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 103d7475 >2013-12-04 10:06:27,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5f1a34, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@529eef4c}, log id: 103d7475 >2013-12-04 10:06:32,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b7bea6e >2013-12-04 10:06:32,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b7bea6e >2013-12-04 10:06:32,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10f0c2b0 >2013-12-04 10:06:33,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3eb8e41a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b76cd7f9}, log id: 10f0c2b0 >2013-12-04 10:06:38,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4ffaed8a >2013-12-04 10:06:38,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4ffaed8a >2013-12-04 10:06:38,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b2ccd9e >2013-12-04 10:06:38,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a252d7ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@363e86d}, log id: 5b2ccd9e >2013-12-04 10:06:43,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4f3e7a1e >2013-12-04 10:06:44,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f3e7a1e >2013-12-04 10:06:44,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5e2ce85f >2013-12-04 10:06:44,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@faa74a4d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eec313f8}, log id: 5e2ce85f >2013-12-04 10:06:49,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 46516296 >2013-12-04 10:06:50,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 46516296 >2013-12-04 10:06:50,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4564dfd1 >2013-12-04 10:06:50,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e786ebf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a7fb9c4}, log id: 4564dfd1 >2013-12-04 10:06:55,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5c2c338d >2013-12-04 10:06:56,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c2c338d >2013-12-04 10:06:56,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 66179a20 >2013-12-04 10:06:56,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e3d06e6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64167123}, log id: 66179a20 >2013-12-04 10:07:01,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 754c1c25 >2013-12-04 10:07:01,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 754c1c25 >2013-12-04 10:07:01,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 539a14cd >2013-12-04 10:07:02,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0179501, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8de9425}, log id: 539a14cd >2013-12-04 10:07:02,501 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-7) No up server in cluster >2013-12-04 10:07:02,501 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-7) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:07:02,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 505a4c25 >2013-12-04 10:07:02,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, return: [], log id: 505a4c25 >2013-12-04 10:07:07,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: fbdcbd9 >2013-12-04 10:07:07,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: fbdcbd9 >2013-12-04 10:07:07,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5308cbd4 >2013-12-04 10:07:07,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfc66a93, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5e74f94}, log id: 5308cbd4 >2013-12-04 10:07:13,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6a076c6 >2013-12-04 10:07:13,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a076c6 >2013-12-04 10:07:13,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 66f85689 >2013-12-04 10:07:13,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d10fbccd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72b7bd24}, log id: 66f85689 >2013-12-04 10:07:18,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4e44273a >2013-12-04 10:07:19,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e44273a >2013-12-04 10:07:19,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 34f3abed >2013-12-04 10:07:19,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99b2bf5c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c13987bb}, log id: 34f3abed >2013-12-04 10:07:24,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 54a7d4cc >2013-12-04 10:07:25,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 54a7d4cc >2013-12-04 10:07:25,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 47269397 >2013-12-04 10:07:25,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfe75c1e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b01bbc3b}, log id: 47269397 >2013-12-04 10:07:30,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 159a4998 >2013-12-04 10:07:30,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 159a4998 >2013-12-04 10:07:30,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 37f1acf >2013-12-04 10:07:31,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2895239c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3fad928}, log id: 37f1acf >2013-12-04 10:07:36,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: a9cfb7c >2013-12-04 10:07:36,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: a9cfb7c >2013-12-04 10:07:36,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 398b468 >2013-12-04 10:07:37,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae8b16b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e8f7aa7}, log id: 398b468 >2013-12-04 10:07:42,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5fdcdb5a >2013-12-04 10:07:42,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5fdcdb5a >2013-12-04 10:07:42,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 359553cf >2013-12-04 10:07:42,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62bf6358, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d37a798}, log id: 359553cf >2013-12-04 10:07:47,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 361744f6 >2013-12-04 10:07:48,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 361744f6 >2013-12-04 10:07:48,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5baf8e32 >2013-12-04 10:07:48,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27d0e7c7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@911faeca}, log id: 5baf8e32 >2013-12-04 10:07:53,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6dc536dd >2013-12-04 10:07:54,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6dc536dd >2013-12-04 10:07:54,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 28e33fb3 >2013-12-04 10:07:54,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c725a028, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef162be5}, log id: 28e33fb3 >2013-12-04 10:07:59,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 51db6be7 >2013-12-04 10:08:00,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 51db6be7 >2013-12-04 10:08:00,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6905589e >2013-12-04 10:08:00,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaeeba93, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c358efe}, log id: 6905589e >2013-12-04 10:08:02,806 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) No up server in cluster >2013-12-04 10:08:02,823 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:08:02,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 566b30de >2013-12-04 10:08:03,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, return: [], log id: 566b30de >2013-12-04 10:08:05,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b08b618 >2013-12-04 10:08:05,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6b08b618 >2013-12-04 10:08:05,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63401e3c >2013-12-04 10:08:06,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7188782, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f019324}, log id: 63401e3c >2013-12-04 10:08:11,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f610b7d >2013-12-04 10:08:11,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7f610b7d >2013-12-04 10:08:11,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: fcfd9aa >2013-12-04 10:08:11,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb15a2ae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baf1a535}, log id: fcfd9aa >2013-12-04 10:08:16,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 314f5724 >2013-12-04 10:08:17,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 314f5724 >2013-12-04 10:08:17,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a5b772f >2013-12-04 10:08:17,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6e2236c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c00801}, log id: 3a5b772f >2013-12-04 10:08:22,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6269c29 >2013-12-04 10:08:23,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6269c29 >2013-12-04 10:08:23,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 753cc96f >2013-12-04 10:08:23,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57922a1f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44211f69}, log id: 753cc96f >2013-12-04 10:08:28,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 9a06ac3 >2013-12-04 10:08:29,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 9a06ac3 >2013-12-04 10:08:29,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 37e35d22 >2013-12-04 10:08:29,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33ffb286, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4d99cdb}, log id: 37e35d22 >2013-12-04 10:08:34,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 568a1957 >2013-12-04 10:08:34,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 568a1957 >2013-12-04 10:08:34,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 19f95b8c >2013-12-04 10:08:35,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e67e0fc8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52ee280f}, log id: 19f95b8c >2013-12-04 10:08:40,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a794454 >2013-12-04 10:08:40,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6a794454 >2013-12-04 10:08:40,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 11fc4f5c >2013-12-04 10:08:40,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d4c4e0d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87d439fb}, log id: 11fc4f5c >2013-12-04 10:08:45,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e5f8227 >2013-12-04 10:08:46,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4e5f8227 >2013-12-04 10:08:46,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79e93a81 >2013-12-04 10:08:46,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61357016, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c79bef2}, log id: 79e93a81 >2013-12-04 10:08:51,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e92758d >2013-12-04 10:08:52,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7e92758d >2013-12-04 10:08:52,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 290fd8a4 >2013-12-04 10:08:52,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79a1776a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b298491c}, log id: 290fd8a4 >2013-12-04 10:08:57,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6e668575 >2013-12-04 10:08:58,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e668575 >2013-12-04 10:08:58,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 540d6a32 >2013-12-04 10:08:58,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c80b922, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eaa6b57c}, log id: 540d6a32 >2013-12-04 10:09:03,137 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-04 10:09:03,160 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:09:03,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f7b6526 >2013-12-04 10:09:03,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57ee72b6 >2013-12-04 10:09:03,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7f7b6526 >2013-12-04 10:09:03,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 57ee72b6 >2013-12-04 10:09:03,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2fc82fca >2013-12-04 10:09:04,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51d9cb80, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf250224}, log id: 2fc82fca >2013-12-04 10:09:09,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f3c6dec >2013-12-04 10:09:09,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5f3c6dec >2013-12-04 10:09:09,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3cb25534 >2013-12-04 10:09:10,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c908653e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9def46}, log id: 3cb25534 >2013-12-04 10:09:15,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ffdc377 >2013-12-04 10:09:15,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4ffdc377 >2013-12-04 10:09:15,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 455bd99b >2013-12-04 10:09:15,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@132878e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42ae41b7}, log id: 455bd99b >2013-12-04 10:09:20,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 42fd57f9 >2013-12-04 10:09:21,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 42fd57f9 >2013-12-04 10:09:21,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 9274d24 >2013-12-04 10:09:21,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f39bc3a0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@657d05ed}, log id: 9274d24 >2013-12-04 10:09:26,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e8da4e2 >2013-12-04 10:09:27,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e8da4e2 >2013-12-04 10:09:27,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17f359ff >2013-12-04 10:09:27,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3730f5d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@492001f0}, log id: 17f359ff >2013-12-04 10:09:32,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 146ed32 >2013-12-04 10:09:33,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 146ed32 >2013-12-04 10:09:33,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69e7aec2 >2013-12-04 10:09:33,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50a677a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6900a26d}, log id: 69e7aec2 >2013-12-04 10:09:38,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b34ec03 >2013-12-04 10:09:38,611 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-13) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:09:38,977 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-13) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:09:38,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b34ec03 >2013-12-04 10:09:38,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42b7d20 >2013-12-04 10:09:38,994 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-20) [6dd5dead] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:09:39,181 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-20) [6dd5dead] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:09:39,182 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-20) [6dd5dead] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:09:39,182 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-20) [6dd5dead] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:09:39,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4d6c530b, log id: 42b7d20 >2013-12-04 10:09:39,265 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-13) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:09:39,267 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-20) [6dd5dead] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:09:39,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c01ee3 >2013-12-04 10:09:39,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@24625d2, log id: 2c01ee3 >2013-12-04 10:09:39,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4b5cff28 >2013-12-04 10:09:39,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d1a737c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5218a167}, log id: 4b5cff28 >2013-12-04 10:09:44,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2354c863 >2013-12-04 10:09:45,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2354c863 >2013-12-04 10:09:45,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 73df2729 >2013-12-04 10:09:45,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1573c01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef2b63aa}, log id: 73df2729 >2013-12-04 10:09:50,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b3b78df >2013-12-04 10:09:51,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4b3b78df >2013-12-04 10:09:51,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4df04565 >2013-12-04 10:09:51,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41e04ad0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27ea95e6}, log id: 4df04565 >2013-12-04 10:09:56,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 419a0772 >2013-12-04 10:09:57,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 419a0772 >2013-12-04 10:09:57,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 75d65a9f >2013-12-04 10:09:57,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79fcfbd3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3dc3642}, log id: 75d65a9f >2013-12-04 10:10:02,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f63b9a >2013-12-04 10:10:02,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4f63b9a >2013-12-04 10:10:02,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6e4928ec >2013-12-04 10:10:03,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3d3ddb4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d717c39}, log id: 6e4928ec >2013-12-04 10:10:03,488 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2013-12-04 10:10:03,488 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:10:03,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d4b6493 >2013-12-04 10:10:03,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7d4b6493 >2013-12-04 10:10:08,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e778463 >2013-12-04 10:10:08,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7e778463 >2013-12-04 10:10:08,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 26cfbed7 >2013-12-04 10:10:08,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a96abbc1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@971d0f36}, log id: 26cfbed7 >2013-12-04 10:10:13,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6f53d5be >2013-12-04 10:10:14,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f53d5be >2013-12-04 10:10:14,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4007279d >2013-12-04 10:10:14,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53ec3446, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ebd99f7}, log id: 4007279d >2013-12-04 10:10:19,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 39654a76 >2013-12-04 10:10:20,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 39654a76 >2013-12-04 10:10:20,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5235b3d >2013-12-04 10:10:20,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c04cd673, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2b7f0bd}, log id: 5235b3d >2013-12-04 10:10:25,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3e301cb1 >2013-12-04 10:10:26,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e301cb1 >2013-12-04 10:10:26,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3bdac2e5 >2013-12-04 10:10:26,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@729a8d51, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec9654aa}, log id: 3bdac2e5 >2013-12-04 10:10:31,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5210622f >2013-12-04 10:10:31,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5210622f >2013-12-04 10:10:31,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 52010cb8 >2013-12-04 10:10:32,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30dee794, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16869ba2}, log id: 52010cb8 >2013-12-04 10:10:37,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34b580c1 >2013-12-04 10:10:37,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 34b580c1 >2013-12-04 10:10:37,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d41b253 >2013-12-04 10:10:38,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cc67c3a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b10bd179}, log id: d41b253 >2013-12-04 10:10:43,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27289783 >2013-12-04 10:10:43,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 27289783 >2013-12-04 10:10:43,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7661c76b >2013-12-04 10:10:43,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec9020a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2adf4aef}, log id: 7661c76b >2013-12-04 10:10:48,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3e995883 >2013-12-04 10:10:49,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3e995883 >2013-12-04 10:10:49,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 285a90f7 >2013-12-04 10:10:49,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29ae89ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d47fed7}, log id: 285a90f7 >2013-12-04 10:10:54,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 649a96b2 >2013-12-04 10:10:55,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 649a96b2 >2013-12-04 10:10:55,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 51ac85b8 >2013-12-04 10:10:55,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4dfaf21f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8f4ff50}, log id: 51ac85b8 >2013-12-04 10:11:00,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 687a8b37 >2013-12-04 10:11:01,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 687a8b37 >2013-12-04 10:11:01,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21e9ea44 >2013-12-04 10:11:01,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6143311f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4085d54c}, log id: 21e9ea44 >2013-12-04 10:11:03,817 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) No up server in cluster >2013-12-04 10:11:03,818 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:11:03,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7d8c011a >2013-12-04 10:11:04,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7d8c011a >2013-12-04 10:11:06,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b48136 >2013-12-04 10:11:06,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4b48136 >2013-12-04 10:11:06,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 568764d6 >2013-12-04 10:11:07,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31af09e0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccb5d42a}, log id: 568764d6 >2013-12-04 10:11:12,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2b2a467c >2013-12-04 10:11:12,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b2a467c >2013-12-04 10:11:12,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 73d653d2 >2013-12-04 10:11:12,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38f0a9c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@345259fa}, log id: 73d653d2 >2013-12-04 10:11:18,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4bb40f84 >2013-12-04 10:11:18,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bb40f84 >2013-12-04 10:11:18,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7b10b349 >2013-12-04 10:11:18,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0f5fbf0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@188c8793}, log id: 7b10b349 >2013-12-04 10:11:23,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e87150f >2013-12-04 10:11:24,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7e87150f >2013-12-04 10:11:24,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 57567c9a >2013-12-04 10:11:24,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6f9fa59, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8aed4379}, log id: 57567c9a >2013-12-04 10:11:29,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 46b5487a >2013-12-04 10:11:30,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 46b5487a >2013-12-04 10:11:30,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 17715734 >2013-12-04 10:11:30,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73c76e4b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@debaed12}, log id: 17715734 >2013-12-04 10:11:35,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5dd8e392 >2013-12-04 10:11:35,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5dd8e392 >2013-12-04 10:11:35,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75512e80 >2013-12-04 10:11:36,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@616c11db, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7193f4a}, log id: 75512e80 >2013-12-04 10:11:41,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74fafebe >2013-12-04 10:11:41,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 74fafebe >2013-12-04 10:11:41,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24e715b4 >2013-12-04 10:11:42,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b69538bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddb55f77}, log id: 24e715b4 >2013-12-04 10:11:47,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 62ba419c >2013-12-04 10:11:47,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 62ba419c >2013-12-04 10:11:47,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5afa6e35 >2013-12-04 10:11:47,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6994f32, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dbb2aa9}, log id: 5afa6e35 >2013-12-04 10:11:52,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: e0e9e76 >2013-12-04 10:11:53,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: e0e9e76 >2013-12-04 10:11:53,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40282484 >2013-12-04 10:11:53,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2dea1b01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce3de07e}, log id: 40282484 >2013-12-04 10:11:58,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b12736 >2013-12-04 10:11:59,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5b12736 >2013-12-04 10:11:59,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6bcaae23 >2013-12-04 10:11:59,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2683b7ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8e73fee}, log id: 6bcaae23 >2013-12-04 10:12:04,126 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-04 10:12:04,131 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:12:04,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d3c6d27 >2013-12-04 10:12:04,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2d3c6d27 >2013-12-04 10:12:04,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 383128b3 >2013-12-04 10:12:05,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 383128b3 >2013-12-04 10:12:05,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6938a3df >2013-12-04 10:12:05,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca5bd8d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31b31300}, log id: 6938a3df >2013-12-04 10:12:10,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1ecaeee4 >2013-12-04 10:12:10,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1ecaeee4 >2013-12-04 10:12:10,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fffeeb1 >2013-12-04 10:12:11,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c52a3957, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fc8cf72}, log id: 2fffeeb1 >2013-12-04 10:12:16,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f52741d >2013-12-04 10:12:16,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3f52741d >2013-12-04 10:12:16,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: de22b75 >2013-12-04 10:12:16,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@127a653, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b863f73}, log id: de22b75 >2013-12-04 10:12:22,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2934f995 >2013-12-04 10:12:22,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2934f995 >2013-12-04 10:12:22,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43048985 >2013-12-04 10:12:22,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5182d15e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0524146}, log id: 43048985 >2013-12-04 10:12:27,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2fdc734c >2013-12-04 10:12:28,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2fdc734c >2013-12-04 10:12:28,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b79814e >2013-12-04 10:12:28,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e40b8e04, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b299261a}, log id: 3b79814e >2013-12-04 10:12:33,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4d814568 >2013-12-04 10:12:34,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d814568 >2013-12-04 10:12:34,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6155d94e >2013-12-04 10:12:34,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fbb72ac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@910d0eb4}, log id: 6155d94e >2013-12-04 10:12:39,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2154b73e >2013-12-04 10:12:39,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2154b73e >2013-12-04 10:12:39,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17f7feab >2013-12-04 10:12:40,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2194641, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbf2a9e8}, log id: 17f7feab >2013-12-04 10:12:45,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1fef871e >2013-12-04 10:12:45,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fef871e >2013-12-04 10:12:45,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2ce65c4f >2013-12-04 10:12:46,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c3307f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eba4150a}, log id: 2ce65c4f >2013-12-04 10:12:51,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a4333a >2013-12-04 10:12:51,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a4333a >2013-12-04 10:12:51,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9079ee5 >2013-12-04 10:12:51,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b685af59, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4d0541}, log id: 9079ee5 >2013-12-04 10:12:56,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4185e83f >2013-12-04 10:12:57,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4185e83f >2013-12-04 10:12:57,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2446aa08 >2013-12-04 10:12:57,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c46deb4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4a73cab}, log id: 2446aa08 >2013-12-04 10:13:02,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47a3a65e >2013-12-04 10:13:03,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 47a3a65e >2013-12-04 10:13:03,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53922eef >2013-12-04 10:13:03,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7514771c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d10263b6}, log id: 53922eef >2013-12-04 10:13:04,440 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) No up server in cluster >2013-12-04 10:13:04,462 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:13:04,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 484d347f >2013-12-04 10:13:04,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, return: [], log id: 484d347f >2013-12-04 10:13:08,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6c7a388d >2013-12-04 10:13:09,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c7a388d >2013-12-04 10:13:09,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3216aadb >2013-12-04 10:13:09,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65ed35b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21aeceb3}, log id: 3216aadb >2013-12-04 10:13:14,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5483801a >2013-12-04 10:13:14,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5483801a >2013-12-04 10:13:14,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14705914 >2013-12-04 10:13:15,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f493ca8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d332d1a}, log id: 14705914 >2013-12-04 10:13:20,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10d8e3e4 >2013-12-04 10:13:20,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 10d8e3e4 >2013-12-04 10:13:20,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2422e537 >2013-12-04 10:13:20,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf29106a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@384c88c4}, log id: 2422e537 >2013-12-04 10:13:26,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7948cce5 >2013-12-04 10:13:26,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7948cce5 >2013-12-04 10:13:26,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 34b4d506 >2013-12-04 10:13:26,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@887a7f01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73220fc7}, log id: 34b4d506 >2013-12-04 10:13:31,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2580ffef >2013-12-04 10:13:32,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2580ffef >2013-12-04 10:13:32,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7c56e9f7 >2013-12-04 10:13:32,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e790e5ff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7583f15}, log id: 7c56e9f7 >2013-12-04 10:13:37,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 75fb1597 >2013-12-04 10:13:38,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 75fb1597 >2013-12-04 10:13:38,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 464579e >2013-12-04 10:13:38,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66de61d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ddd13d2}, log id: 464579e >2013-12-04 10:13:43,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3468766c >2013-12-04 10:13:43,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3468766c >2013-12-04 10:13:43,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 48cd230e >2013-12-04 10:13:44,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54310f68, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fee0d57}, log id: 48cd230e >2013-12-04 10:13:49,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 64b14642 >2013-12-04 10:13:49,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 64b14642 >2013-12-04 10:13:49,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5df668ce >2013-12-04 10:13:50,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56fe0317, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0ae082}, log id: 5df668ce >2013-12-04 10:13:55,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 473949f >2013-12-04 10:13:55,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 473949f >2013-12-04 10:13:55,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53cc473b >2013-12-04 10:13:55,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2ef1be2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57154ce4}, log id: 53cc473b >2013-12-04 10:14:00,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4fea2385 >2013-12-04 10:14:01,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4fea2385 >2013-12-04 10:14:01,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f1c458e >2013-12-04 10:14:01,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ee9d438, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20969fdd}, log id: 5f1c458e >2013-12-04 10:14:04,765 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-04 10:14:04,773 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:14:04,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b2fa8b4 >2013-12-04 10:14:05,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1b2fa8b4 >2013-12-04 10:14:06,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5467be20 >2013-12-04 10:14:07,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5467be20 >2013-12-04 10:14:07,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 463f64c3 >2013-12-04 10:14:07,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac11ebb9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9dd3b53}, log id: 463f64c3 >2013-12-04 10:14:12,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 57601311 >2013-12-04 10:14:12,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 57601311 >2013-12-04 10:14:12,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27536d74 >2013-12-04 10:14:13,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3176be8c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae5d8cc}, log id: 27536d74 >2013-12-04 10:14:18,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 740fc752 >2013-12-04 10:14:18,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 740fc752 >2013-12-04 10:14:18,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 451a4d94 >2013-12-04 10:14:19,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9419a1db, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2dce1c3}, log id: 451a4d94 >2013-12-04 10:14:24,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4c3168fb >2013-12-04 10:14:24,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4c3168fb >2013-12-04 10:14:24,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ab1eb28 >2013-12-04 10:14:24,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efbad7f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6a7ccfe}, log id: 4ab1eb28 >2013-12-04 10:14:29,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4834204b >2013-12-04 10:14:30,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4834204b >2013-12-04 10:14:30,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: cad9f0a >2013-12-04 10:14:30,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da876d8e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed4dd6c8}, log id: cad9f0a >2013-12-04 10:14:35,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1e25720a >2013-12-04 10:14:36,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1e25720a >2013-12-04 10:14:36,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fbd66a0 >2013-12-04 10:14:36,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8a4411b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e12089a}, log id: 2fbd66a0 >2013-12-04 10:14:39,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6e33801a >2013-12-04 10:14:39,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@ff96872, log id: 6e33801a >2013-12-04 10:14:39,870 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-38) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:14:39,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3f381c8f >2013-12-04 10:14:40,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6becb235, log id: 3f381c8f >2013-12-04 10:14:41,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5ab863bb >2013-12-04 10:14:42,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ab863bb >2013-12-04 10:14:42,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6a20a1b2 >2013-12-04 10:14:42,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f454dbd1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b7b49d7}, log id: 6a20a1b2 >2013-12-04 10:14:47,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: e242538 >2013-12-04 10:14:47,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: e242538 >2013-12-04 10:14:47,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2dc67891 >2013-12-04 10:14:48,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8acc5cb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@632f56c3}, log id: 2dc67891 >2013-12-04 10:14:53,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 90d661c >2013-12-04 10:14:53,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 90d661c >2013-12-04 10:14:53,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2763baa5 >2013-12-04 10:14:54,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@566ad1b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@551eea97}, log id: 2763baa5 >2013-12-04 10:14:59,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2885992f >2013-12-04 10:14:59,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2885992f >2013-12-04 10:14:59,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 574c0f6b >2013-12-04 10:14:59,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4762d378, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccc77753}, log id: 574c0f6b >2013-12-04 10:15:04,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 577cc48d >2013-12-04 10:15:05,097 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-04 10:15:05,107 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:15:05,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1acc712e >2013-12-04 10:15:05,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 577cc48d >2013-12-04 10:15:05,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 573dcacb >2013-12-04 10:15:05,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1acc712e >2013-12-04 10:15:05,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8efa87c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2081f7ec}, log id: 573dcacb >2013-12-04 10:15:10,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 47b7905f >2013-12-04 10:15:11,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 47b7905f >2013-12-04 10:15:11,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71e3a7eb >2013-12-04 10:15:11,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a840f81, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1148012d}, log id: 71e3a7eb >2013-12-04 10:15:16,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f54a7a6 >2013-12-04 10:15:16,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7f54a7a6 >2013-12-04 10:15:16,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 543deaf2 >2013-12-04 10:15:17,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@558f5659, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c1ae8ea}, log id: 543deaf2 >2013-12-04 10:15:22,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4fa05186 >2013-12-04 10:15:22,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4fa05186 >2013-12-04 10:15:22,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45aae649 >2013-12-04 10:15:22,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec4d6ba1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e37ddfa}, log id: 45aae649 >2013-12-04 10:15:28,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 292d9426 >2013-12-04 10:15:28,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 292d9426 >2013-12-04 10:15:28,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 295082a9 >2013-12-04 10:15:28,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7445ad9e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@501dc3dc}, log id: 295082a9 >2013-12-04 10:15:33,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 631ae41a >2013-12-04 10:15:34,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 631ae41a >2013-12-04 10:15:34,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 35fc893 >2013-12-04 10:15:34,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd17904a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea19600}, log id: 35fc893 >2013-12-04 10:15:39,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1d576c1f >2013-12-04 10:15:40,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1d576c1f >2013-12-04 10:15:40,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 466068b >2013-12-04 10:15:40,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c6db3ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f156efbe}, log id: 466068b >2013-12-04 10:15:45,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1bcf5595 >2013-12-04 10:15:45,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1bcf5595 >2013-12-04 10:15:45,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 61f1712e >2013-12-04 10:15:46,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ac0dde6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87b4626d}, log id: 61f1712e >2013-12-04 10:15:51,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4877f600 >2013-12-04 10:15:51,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4877f600 >2013-12-04 10:15:51,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 30458a72 >2013-12-04 10:15:52,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e289accc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d03df8e}, log id: 30458a72 >2013-12-04 10:15:57,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47f97af1 >2013-12-04 10:15:57,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 47f97af1 >2013-12-04 10:15:57,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 237ff494 >2013-12-04 10:15:57,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17e5cbe4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45d0d952}, log id: 237ff494 >2013-12-04 10:16:02,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5333f5d5 >2013-12-04 10:16:03,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5333f5d5 >2013-12-04 10:16:03,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4546f7ac >2013-12-04 10:16:03,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9af0d21b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@584b62a9}, log id: 4546f7ac >2013-12-04 10:16:05,420 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) [4ca24342] No up server in cluster >2013-12-04 10:16:05,421 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) [4ca24342] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:16:05,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b024525 >2013-12-04 10:16:05,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6b024525 >2013-12-04 10:16:08,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 64af10cc >2013-12-04 10:16:09,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 64af10cc >2013-12-04 10:16:09,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2d1e8be1 >2013-12-04 10:16:09,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7eca28f1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b5c207a}, log id: 2d1e8be1 >2013-12-04 10:16:14,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7212c3d0 >2013-12-04 10:16:14,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7212c3d0 >2013-12-04 10:16:14,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3e58529c >2013-12-04 10:16:15,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b912b660, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9bf89f5}, log id: 3e58529c >2013-12-04 10:16:20,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 50fcf0f8 >2013-12-04 10:16:20,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 50fcf0f8 >2013-12-04 10:16:20,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 34d9a6d4 >2013-12-04 10:16:21,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad43f370, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8af87f57}, log id: 34d9a6d4 >2013-12-04 10:16:26,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c56f094 >2013-12-04 10:16:26,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1c56f094 >2013-12-04 10:16:26,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3753ed94 >2013-12-04 10:16:26,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79c87e0f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b610c186}, log id: 3753ed94 >2013-12-04 10:16:31,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e135a25 >2013-12-04 10:16:32,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e135a25 >2013-12-04 10:16:32,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3b2de82f >2013-12-04 10:16:32,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de7d00b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74e3ea4c}, log id: 3b2de82f >2013-12-04 10:16:37,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1ea41f12 >2013-12-04 10:16:38,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ea41f12 >2013-12-04 10:16:38,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: b4b4f4e >2013-12-04 10:16:38,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@574881af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69ca26b4}, log id: b4b4f4e >2013-12-04 10:16:43,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1dfb7a1d >2013-12-04 10:16:44,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1dfb7a1d >2013-12-04 10:16:44,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 60127f4c >2013-12-04 10:16:44,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75744045, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6a8111b}, log id: 60127f4c >2013-12-04 10:16:49,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4864a9d >2013-12-04 10:16:49,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4864a9d >2013-12-04 10:16:49,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57d6cf10 >2013-12-04 10:16:50,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2e25a9c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80060a68}, log id: 57d6cf10 >2013-12-04 10:16:55,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6bb72d0a >2013-12-04 10:16:55,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bb72d0a >2013-12-04 10:16:55,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 66b1d103 >2013-12-04 10:16:56,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8076817f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4a5f0b0}, log id: 66b1d103 >2013-12-04 10:17:01,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1606ad9f >2013-12-04 10:17:01,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1606ad9f >2013-12-04 10:17:01,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 29226582 >2013-12-04 10:17:01,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ce4a364, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cd5cb58}, log id: 29226582 >2013-12-04 10:17:05,723 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) No up server in cluster >2013-12-04 10:17:05,725 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:17:05,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 747af928 >2013-12-04 10:17:06,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, return: [], log id: 747af928 >2013-12-04 10:17:06,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 632e83a5 >2013-12-04 10:17:07,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 632e83a5 >2013-12-04 10:17:07,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d9664ca >2013-12-04 10:17:07,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61031bf8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3600801c}, log id: 1d9664ca >2013-12-04 10:17:12,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2a1beb20 >2013-12-04 10:17:13,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a1beb20 >2013-12-04 10:17:13,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 511f2f65 >2013-12-04 10:17:13,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47d6cd7b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6568fbdd}, log id: 511f2f65 >2013-12-04 10:17:18,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9c3ea1a >2013-12-04 10:17:19,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 9c3ea1a >2013-12-04 10:17:19,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4fd7a33e >2013-12-04 10:17:19,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e17c81df, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@642ecc5c}, log id: 4fd7a33e >2013-12-04 10:17:24,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 682994a8 >2013-12-04 10:17:24,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 682994a8 >2013-12-04 10:17:24,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63fe59a2 >2013-12-04 10:17:25,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a284ac83, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce03bd64}, log id: 63fe59a2 >2013-12-04 10:17:30,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ab83e98 >2013-12-04 10:17:30,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4ab83e98 >2013-12-04 10:17:30,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b9c74fd >2013-12-04 10:17:31,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26b61b89, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@210b81d1}, log id: b9c74fd >2013-12-04 10:17:36,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1d14f430 >2013-12-04 10:17:36,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1d14f430 >2013-12-04 10:17:36,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a3e2c7b >2013-12-04 10:17:36,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a36056ff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b92f2698}, log id: 6a3e2c7b >2013-12-04 10:17:41,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 54b8fd5b >2013-12-04 10:17:42,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 54b8fd5b >2013-12-04 10:17:42,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4fbb7a1a >2013-12-04 10:17:42,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0917c18, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@573b9d7a}, log id: 4fbb7a1a >2013-12-04 10:17:47,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7810aa97 >2013-12-04 10:17:48,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7810aa97 >2013-12-04 10:17:48,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d870c12 >2013-12-04 10:17:48,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2eea88c3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b914251e}, log id: 7d870c12 >2013-12-04 10:17:53,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4c0b68da >2013-12-04 10:17:54,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4c0b68da >2013-12-04 10:17:54,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 51148f6c >2013-12-04 10:17:54,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c392ad2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0add3d1}, log id: 51148f6c >2013-12-04 10:17:59,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 49312fb4 >2013-12-04 10:17:59,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 49312fb4 >2013-12-04 10:17:59,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2bb01db2 >2013-12-04 10:18:00,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78528f02, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@472166a}, log id: 2bb01db2 >2013-12-04 10:18:05,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 300d6080 >2013-12-04 10:18:05,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 300d6080 >2013-12-04 10:18:05,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5ff03b42 >2013-12-04 10:18:06,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@558a07a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f386d01}, log id: 5ff03b42 >2013-12-04 10:18:06,041 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) No up server in cluster >2013-12-04 10:18:06,043 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:18:06,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3fb8d65a >2013-12-04 10:18:06,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3fb8d65a >2013-12-04 10:18:11,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a4f0b92 >2013-12-04 10:18:11,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: a4f0b92 >2013-12-04 10:18:11,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e8bdab >2013-12-04 10:18:11,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4c8720a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41b4f5c8}, log id: 3e8bdab >2013-12-04 10:18:16,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2b5bdc17 >2013-12-04 10:18:17,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b5bdc17 >2013-12-04 10:18:17,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: e338f0e >2013-12-04 10:18:17,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e081315, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b3f406a}, log id: e338f0e >2013-12-04 10:18:22,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4054f857 >2013-12-04 10:18:23,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4054f857 >2013-12-04 10:18:23,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ff2d26e >2013-12-04 10:18:23,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcadc26b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d500ac5}, log id: 4ff2d26e >2013-12-04 10:18:28,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4801e733 >2013-12-04 10:18:28,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4801e733 >2013-12-04 10:18:28,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a7918c >2013-12-04 10:18:29,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1618192, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdc292fc}, log id: 6a7918c >2013-12-04 10:18:34,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 461dc92e >2013-12-04 10:18:34,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 461dc92e >2013-12-04 10:18:34,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 35374dfd >2013-12-04 10:18:35,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41f7a316, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5e89542}, log id: 35374dfd >2013-12-04 10:18:40,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6d4e41e2 >2013-12-04 10:18:40,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6d4e41e2 >2013-12-04 10:18:40,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46df83a6 >2013-12-04 10:18:40,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d28af7a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d879ef7d}, log id: 46df83a6 >2013-12-04 10:18:45,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 61e1cf8f >2013-12-04 10:18:46,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 61e1cf8f >2013-12-04 10:18:46,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 52f8ae00 >2013-12-04 10:18:46,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bd92766, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c71b33ab}, log id: 52f8ae00 >2013-12-04 10:18:51,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 93bc055 >2013-12-04 10:18:52,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 93bc055 >2013-12-04 10:18:52,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3144d1c0 >2013-12-04 10:18:52,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27f41448, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@360a33cf}, log id: 3144d1c0 >2013-12-04 10:18:57,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 210fbc19 >2013-12-04 10:18:58,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 210fbc19 >2013-12-04 10:18:58,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f56130b >2013-12-04 10:18:58,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@247fe522, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@702c33c7}, log id: 5f56130b >2013-12-04 10:19:03,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e2f867a >2013-12-04 10:19:03,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e2f867a >2013-12-04 10:19:03,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b78be68 >2013-12-04 10:19:04,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7b41c9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e962ffd}, log id: 4b78be68 >2013-12-04 10:19:06,362 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-04 10:19:06,362 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:19:06,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1f3dc63 >2013-12-04 10:19:06,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1f3dc63 >2013-12-04 10:19:09,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18905936 >2013-12-04 10:19:09,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 18905936 >2013-12-04 10:19:09,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f46e97 >2013-12-04 10:19:09,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50c6ec01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b6e84d7}, log id: 4f46e97 >2013-12-04 10:19:15,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b4733c1 >2013-12-04 10:19:15,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6b4733c1 >2013-12-04 10:19:15,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 270f63ec >2013-12-04 10:19:15,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4faf091c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d06112b}, log id: 270f63ec >2013-12-04 10:19:20,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59c2a2ac >2013-12-04 10:19:21,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 59c2a2ac >2013-12-04 10:19:21,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15a85df3 >2013-12-04 10:19:21,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6a5f7dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2583143e}, log id: 15a85df3 >2013-12-04 10:19:26,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 270857e6 >2013-12-04 10:19:27,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 270857e6 >2013-12-04 10:19:27,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 24279c12 >2013-12-04 10:19:27,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d872e0c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1da9bb5}, log id: 24279c12 >2013-12-04 10:19:32,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: c1c5fbc >2013-12-04 10:19:32,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: c1c5fbc >2013-12-04 10:19:32,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1e5e464b >2013-12-04 10:19:33,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d66fe62a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10852779}, log id: 1e5e464b >2013-12-04 10:19:38,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27ff9101 >2013-12-04 10:19:38,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 27ff9101 >2013-12-04 10:19:38,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57ff876f >2013-12-04 10:19:39,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c0b9742, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc0d9940}, log id: 57ff876f >2013-12-04 10:19:40,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67665f29 >2013-12-04 10:19:40,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1f22dce, log id: 67665f29 >2013-12-04 10:19:40,447 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-17) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:19:40,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 429d3061 >2013-12-04 10:19:40,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@17b94521, log id: 429d3061 >2013-12-04 10:19:44,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 55698784 >2013-12-04 10:19:44,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 55698784 >2013-12-04 10:19:44,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 89a9a38 >2013-12-04 10:19:44,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87887b07, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c7b4cf}, log id: 89a9a38 >2013-12-04 10:19:49,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e4b7a8f >2013-12-04 10:19:50,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e4b7a8f >2013-12-04 10:19:50,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 13efb479 >2013-12-04 10:19:50,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ef6ef1f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d78ba7d}, log id: 13efb479 >2013-12-04 10:19:55,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a3460be >2013-12-04 10:19:56,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1a3460be >2013-12-04 10:19:56,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4c0b75a9 >2013-12-04 10:19:56,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fd1d45e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f1a860b}, log id: 4c0b75a9 >2013-12-04 10:20:01,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 72b7f638 >2013-12-04 10:20:02,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 72b7f638 >2013-12-04 10:20:02,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 75ea8354 >2013-12-04 10:20:02,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d98ff88, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12b70249}, log id: 75ea8354 >2013-12-04 10:20:06,681 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-04 10:20:06,693 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:20:06,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30f27eeb >2013-12-04 10:20:06,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 30f27eeb >2013-12-04 10:20:07,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 60c2ec74 >2013-12-04 10:20:07,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 60c2ec74 >2013-12-04 10:20:07,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 263a0fe6 >2013-12-04 10:20:08,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dad08f0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6a55f1}, log id: 263a0fe6 >2013-12-04 10:20:13,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 644b4d01 >2013-12-04 10:20:13,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 644b4d01 >2013-12-04 10:20:13,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 58050923 >2013-12-04 10:20:13,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0613fd1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b24ffb0f}, log id: 58050923 >2013-12-04 10:20:18,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58ce4de5 >2013-12-04 10:20:19,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 58ce4de5 >2013-12-04 10:20:19,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6fcdf4ce >2013-12-04 10:20:19,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4ba5f2b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e50d953}, log id: 6fcdf4ce >2013-12-04 10:20:24,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 670c1c6a >2013-12-04 10:20:25,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 670c1c6a >2013-12-04 10:20:25,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4e2dd8ae >2013-12-04 10:20:25,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a8816dc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c9891d6}, log id: 4e2dd8ae >2013-12-04 10:20:30,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 534e070e >2013-12-04 10:20:31,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 534e070e >2013-12-04 10:20:31,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 74f2c951 >2013-12-04 10:20:31,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7992685d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d835f6b}, log id: 74f2c951 >2013-12-04 10:20:36,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e839541 >2013-12-04 10:20:36,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: e839541 >2013-12-04 10:20:36,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59a7c244 >2013-12-04 10:20:37,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abb2f62f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@411c88b2}, log id: 59a7c244 >2013-12-04 10:20:42,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3124ef13 >2013-12-04 10:20:42,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3124ef13 >2013-12-04 10:20:42,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3cc06554 >2013-12-04 10:20:42,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@680fbd11, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa6a6618}, log id: 3cc06554 >2013-12-04 10:20:47,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 114573f8 >2013-12-04 10:20:48,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 114573f8 >2013-12-04 10:20:48,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6717e1 >2013-12-04 10:20:48,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8385323, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a8a7f2a}, log id: 6717e1 >2013-12-04 10:20:53,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 34c93a5 >2013-12-04 10:20:54,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 34c93a5 >2013-12-04 10:20:54,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 717fd722 >2013-12-04 10:20:54,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87c1dcb3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa92066a}, log id: 717fd722 >2013-12-04 10:20:59,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6fd8e5ec >2013-12-04 10:21:00,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6fd8e5ec >2013-12-04 10:21:00,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6338049 >2013-12-04 10:21:00,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7569153, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7046da7b}, log id: 6338049 >2013-12-04 10:21:05,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f631503 >2013-12-04 10:21:05,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5f631503 >2013-12-04 10:21:05,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a4f2cc6 >2013-12-04 10:21:06,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18330320, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b3d9590}, log id: 7a4f2cc6 >2013-12-04 10:21:06,996 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) No up server in cluster >2013-12-04 10:21:06,998 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:21:07,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 743c0cfb >2013-12-04 10:21:07,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, return: [], log id: 743c0cfb >2013-12-04 10:21:11,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 727b9bef >2013-12-04 10:21:11,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 727b9bef >2013-12-04 10:21:11,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47410220 >2013-12-04 10:21:12,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a13939fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a33dd515}, log id: 47410220 >2013-12-04 10:21:17,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5bf15a48 >2013-12-04 10:21:17,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5bf15a48 >2013-12-04 10:21:17,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4d6b06f5 >2013-12-04 10:21:17,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@422cb4ad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f172b9d2}, log id: 4d6b06f5 >2013-12-04 10:21:22,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50012de2 >2013-12-04 10:21:23,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 50012de2 >2013-12-04 10:21:23,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1e8fe4e6 >2013-12-04 10:21:23,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d1f4b87, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50ef282a}, log id: 1e8fe4e6 >2013-12-04 10:21:28,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ae33110 >2013-12-04 10:21:29,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3ae33110 >2013-12-04 10:21:29,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39147645 >2013-12-04 10:21:29,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebacd2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23d1e821}, log id: 39147645 >2013-12-04 10:21:34,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ec91ba3 >2013-12-04 10:21:34,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5ec91ba3 >2013-12-04 10:21:34,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 358e49c8 >2013-12-04 10:21:35,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d958842, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c545993a}, log id: 358e49c8 >2013-12-04 10:21:40,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 777cc772 >2013-12-04 10:21:40,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 777cc772 >2013-12-04 10:21:40,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e1ff124 >2013-12-04 10:21:41,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@118b09a2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed69498a}, log id: 6e1ff124 >2013-12-04 10:21:46,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59f3d5b1 >2013-12-04 10:21:46,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 59f3d5b1 >2013-12-04 10:21:46,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 943b9e1 >2013-12-04 10:21:46,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1420869c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b72d727}, log id: 943b9e1 >2013-12-04 10:21:51,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4caef817 >2013-12-04 10:21:52,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4caef817 >2013-12-04 10:21:52,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 444b926 >2013-12-04 10:21:52,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53062e59, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1875ac}, log id: 444b926 >2013-12-04 10:21:57,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4bccd32e >2013-12-04 10:21:58,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bccd32e >2013-12-04 10:21:58,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 44fbc06c >2013-12-04 10:21:58,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1f49d6c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c692e3b1}, log id: 44fbc06c >2013-12-04 10:22:03,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50f6e2a4 >2013-12-04 10:22:04,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 50f6e2a4 >2013-12-04 10:22:04,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3bea51c0 >2013-12-04 10:22:04,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c653b8ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4789a4e5}, log id: 3bea51c0 >2013-12-04 10:22:07,311 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-04 10:22:07,321 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:22:07,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21938a0a >2013-12-04 10:22:07,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 21938a0a >2013-12-04 10:22:09,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 46f220cd >2013-12-04 10:22:09,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 46f220cd >2013-12-04 10:22:09,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7a116cb2 >2013-12-04 10:22:10,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc7245ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a5af100}, log id: 7a116cb2 >2013-12-04 10:22:15,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4757564 >2013-12-04 10:22:15,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4757564 >2013-12-04 10:22:15,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 274ee6d2 >2013-12-04 10:22:16,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1db1964, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ee1bb4d}, log id: 274ee6d2 >2013-12-04 10:22:21,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b9fcf54 >2013-12-04 10:22:21,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: b9fcf54 >2013-12-04 10:22:21,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70728b10 >2013-12-04 10:22:21,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@def26db8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37c36111}, log id: 70728b10 >2013-12-04 10:22:26,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 70c38164 >2013-12-04 10:22:27,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 70c38164 >2013-12-04 10:22:27,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6bae4c8e >2013-12-04 10:22:27,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b83f04d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@596579d5}, log id: 6bae4c8e >2013-12-04 10:22:32,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: feb8796 >2013-12-04 10:22:33,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: feb8796 >2013-12-04 10:22:33,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27cbd45a >2013-12-04 10:22:33,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28882ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45a88487}, log id: 27cbd45a >2013-12-04 10:22:38,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 186cdecd >2013-12-04 10:22:39,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 186cdecd >2013-12-04 10:22:39,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 547e131e >2013-12-04 10:22:39,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@becd3fca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7171feee}, log id: 547e131e >2013-12-04 10:22:44,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 66c9ed40 >2013-12-04 10:22:44,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 66c9ed40 >2013-12-04 10:22:44,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7967ed8f >2013-12-04 10:22:45,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcd97d4f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3172d4e}, log id: 7967ed8f >2013-12-04 10:22:50,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 585ebda7 >2013-12-04 10:22:50,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 585ebda7 >2013-12-04 10:22:50,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16647614 >2013-12-04 10:22:50,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4737a76, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec2cf6d9}, log id: 16647614 >2013-12-04 10:22:56,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6ffc51a4 >2013-12-04 10:22:56,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6ffc51a4 >2013-12-04 10:22:56,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79a19339 >2013-12-04 10:22:56,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b00320c9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6eb3ba9}, log id: 79a19339 >2013-12-04 10:23:01,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 65393869 >2013-12-04 10:23:02,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 65393869 >2013-12-04 10:23:02,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4db1a328 >2013-12-04 10:23:02,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2aa0f7a7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae03f41f}, log id: 4db1a328 >2013-12-04 10:23:07,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 712c9be6 >2013-12-04 10:23:07,640 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-04 10:23:07,646 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:23:07,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 73b107f8 >2013-12-04 10:23:07,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: 73b107f8 >2013-12-04 10:23:08,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 712c9be6 >2013-12-04 10:23:08,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 24a8008b >2013-12-04 10:23:08,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eacef6aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1010ff66}, log id: 24a8008b >2013-12-04 10:23:13,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b74191c >2013-12-04 10:23:13,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5b74191c >2013-12-04 10:23:13,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3cf53f9 >2013-12-04 10:23:14,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ac39f07, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7243f926}, log id: 3cf53f9 >2013-12-04 10:23:19,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 65556de3 >2013-12-04 10:23:19,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 65556de3 >2013-12-04 10:23:19,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 74c2324a >2013-12-04 10:23:20,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acd31c53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4df5cd2d}, log id: 74c2324a >2013-12-04 10:23:25,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 76e4edec >2013-12-04 10:23:25,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 76e4edec >2013-12-04 10:23:25,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7136a629 >2013-12-04 10:23:25,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c246e370, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69d591b0}, log id: 7136a629 >2013-12-04 10:23:30,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 43624c31 >2013-12-04 10:23:31,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 43624c31 >2013-12-04 10:23:31,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 73aa057d >2013-12-04 10:23:31,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a400bfd5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37273659}, log id: 73aa057d >2013-12-04 10:23:36,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 397f00c7 >2013-12-04 10:23:37,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 397f00c7 >2013-12-04 10:23:37,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6191fd02 >2013-12-04 10:23:37,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef4e8cf7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6240e247}, log id: 6191fd02 >2013-12-04 10:23:42,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1da2a5a2 >2013-12-04 10:23:43,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1da2a5a2 >2013-12-04 10:23:43,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 40dcae3a >2013-12-04 10:23:43,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef7aeffb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76307c24}, log id: 40dcae3a >2013-12-04 10:23:48,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32b1f54c >2013-12-04 10:23:48,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 32b1f54c >2013-12-04 10:23:48,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1662392e >2013-12-04 10:23:49,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1df6d357, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@674ac4e2}, log id: 1662392e >2013-12-04 10:23:54,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4f4fa594 >2013-12-04 10:23:54,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f4fa594 >2013-12-04 10:23:54,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4124f8b2 >2013-12-04 10:23:55,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65c7f752, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ad4161b}, log id: 4124f8b2 >2013-12-04 10:24:00,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 37623756 >2013-12-04 10:24:00,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 37623756 >2013-12-04 10:24:00,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3140d231 >2013-12-04 10:24:00,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@151a581e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9317daf3}, log id: 3140d231 >2013-12-04 10:24:05,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e4d6044 >2013-12-04 10:24:06,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5e4d6044 >2013-12-04 10:24:06,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ddca431 >2013-12-04 10:24:06,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@183636cf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74fcbb6a}, log id: ddca431 >2013-12-04 10:24:07,923 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-04 10:24:07,940 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:24:07,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 509d5577 >2013-12-04 10:24:08,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: 509d5577 >2013-12-04 10:24:11,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 18251e05 >2013-12-04 10:24:12,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 18251e05 >2013-12-04 10:24:12,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 109d8235 >2013-12-04 10:24:12,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34d8da06, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2fa68ed}, log id: 109d8235 >2013-12-04 10:24:17,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7c726945 >2013-12-04 10:24:18,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7c726945 >2013-12-04 10:24:18,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ac592fb >2013-12-04 10:24:18,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2257fd08, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87c383a9}, log id: 4ac592fb >2013-12-04 10:24:23,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4ee0999a >2013-12-04 10:24:23,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4ee0999a >2013-12-04 10:24:23,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 22e1571b >2013-12-04 10:24:24,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c009bb80, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11474911}, log id: 22e1571b >2013-12-04 10:24:29,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4f9cc212 >2013-12-04 10:24:29,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f9cc212 >2013-12-04 10:24:29,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3af5953 >2013-12-04 10:24:30,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f167312, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22801d23}, log id: 3af5953 >2013-12-04 10:24:35,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ee79c22 >2013-12-04 10:24:35,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: ee79c22 >2013-12-04 10:24:35,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12e1aee9 >2013-12-04 10:24:35,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf2b6560, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9bfe0f9}, log id: 12e1aee9 >2013-12-04 10:24:40,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1dbd8a44 >2013-12-04 10:24:40,891 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-27) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:24:41,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3f255875, log id: 1dbd8a44 >2013-12-04 10:24:41,042 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-6) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:24:41,043 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-27) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:24:41,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2cd289b6 >2013-12-04 10:24:41,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6b7b151b, log id: 2cd289b6 >2013-12-04 10:24:41,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5da6d6bd >2013-12-04 10:24:41,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5da6d6bd >2013-12-04 10:24:41,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d10152e >2013-12-04 10:24:42,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f35ccffe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3650e1e0}, log id: 6d10152e >2013-12-04 10:24:47,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 36bea9ad >2013-12-04 10:24:47,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36bea9ad >2013-12-04 10:24:47,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 376cbb87 >2013-12-04 10:24:48,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@404dc9eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b1766a7}, log id: 376cbb87 >2013-12-04 10:24:53,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 723866ba >2013-12-04 10:24:53,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 723866ba >2013-12-04 10:24:53,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 79295219 >2013-12-04 10:24:53,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b55de6dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fa8c13e}, log id: 79295219 >2013-12-04 10:24:58,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4bf3d56b >2013-12-04 10:24:59,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4bf3d56b >2013-12-04 10:24:59,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 324b3576 >2013-12-04 10:24:59,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d856f7c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b1761d1}, log id: 324b3576 >2013-12-04 10:25:04,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43578295 >2013-12-04 10:25:05,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 43578295 >2013-12-04 10:25:05,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 62a31c0 >2013-12-04 10:25:05,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61bab737, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57701d90}, log id: 62a31c0 >2013-12-04 10:25:08,248 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-04 10:25:08,248 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:25:08,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 24ff3a7f >2013-12-04 10:25:08,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 24ff3a7f >2013-12-04 10:25:10,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2d7b6f6b >2013-12-04 10:25:10,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d7b6f6b >2013-12-04 10:25:10,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2c74f3dc >2013-12-04 10:25:11,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c2a52de, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bf3826}, log id: 2c74f3dc >2013-12-04 10:25:16,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1cc547c >2013-12-04 10:25:16,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cc547c >2013-12-04 10:25:16,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 30dce49d >2013-12-04 10:25:17,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@319a5857, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@598539b0}, log id: 30dce49d >2013-12-04 10:25:22,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39a6902 >2013-12-04 10:25:22,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 39a6902 >2013-12-04 10:25:22,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 28410001 >2013-12-04 10:25:22,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1eb18b91, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a9cad17}, log id: 28410001 >2013-12-04 10:25:27,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3b44de7c >2013-12-04 10:25:28,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b44de7c >2013-12-04 10:25:28,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1ce0dc25 >2013-12-04 10:25:28,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6370da88, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d790a35a}, log id: 1ce0dc25 >2013-12-04 10:25:33,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b8b9841 >2013-12-04 10:25:34,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b8b9841 >2013-12-04 10:25:34,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 264fe185 >2013-12-04 10:25:34,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa25c608, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@636ca3c1}, log id: 264fe185 >2013-12-04 10:25:39,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ba04a32 >2013-12-04 10:25:40,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6ba04a32 >2013-12-04 10:25:40,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7b77804a >2013-12-04 10:25:40,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b11877e1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@561df587}, log id: 7b77804a >2013-12-04 10:25:45,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 688990dd >2013-12-04 10:25:45,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 688990dd >2013-12-04 10:25:45,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 750e3b04 >2013-12-04 10:25:46,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef018163, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55fbb863}, log id: 750e3b04 >2013-12-04 10:25:51,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40bdd179 >2013-12-04 10:25:51,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 40bdd179 >2013-12-04 10:25:51,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 57b72f4b >2013-12-04 10:25:52,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15d68aef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e43655ee}, log id: 57b72f4b >2013-12-04 10:25:57,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 588853b7 >2013-12-04 10:25:57,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 588853b7 >2013-12-04 10:25:57,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5c8be6f7 >2013-12-04 10:25:57,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db430c1c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4dc7c0cf}, log id: 5c8be6f7 >2013-12-04 10:26:02,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8818d5f >2013-12-04 10:26:03,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 8818d5f >2013-12-04 10:26:03,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4aeb5105 >2013-12-04 10:26:03,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29e7a92c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3319362}, log id: 4aeb5105 >2013-12-04 10:26:08,553 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) No up server in cluster >2013-12-04 10:26:08,554 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:26:08,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c33e34 >2013-12-04 10:26:08,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61c3668e >2013-12-04 10:26:08,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1c33e34 >2013-12-04 10:26:09,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 61c3668e >2013-12-04 10:26:09,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25a907c8 >2013-12-04 10:26:09,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f51f975, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d83b5e7d}, log id: 25a907c8 >2013-12-04 10:26:14,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 578d490e >2013-12-04 10:26:15,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 578d490e >2013-12-04 10:26:15,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 686857e6 >2013-12-04 10:26:15,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9de5bd44, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@619270ae}, log id: 686857e6 >2013-12-04 10:26:20,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 79cf07f1 >2013-12-04 10:26:20,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 79cf07f1 >2013-12-04 10:26:20,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10cfb22e >2013-12-04 10:26:21,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75a7b685, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b7df0bf}, log id: 10cfb22e >2013-12-04 10:26:26,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6f651dcf >2013-12-04 10:26:26,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f651dcf >2013-12-04 10:26:26,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a2aeb0f >2013-12-04 10:26:27,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e972a970, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a77162fd}, log id: a2aeb0f >2013-12-04 10:26:32,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2c16df0a >2013-12-04 10:26:32,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c16df0a >2013-12-04 10:26:32,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6bc86b7e >2013-12-04 10:26:32,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6dabb31, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2985013}, log id: 6bc86b7e >2013-12-04 10:26:37,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 330a7e6f >2013-12-04 10:26:38,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 330a7e6f >2013-12-04 10:26:38,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7df1a4b7 >2013-12-04 10:26:38,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69e0fb68, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57d0ecb}, log id: 7df1a4b7 >2013-12-04 10:26:43,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59c0e2da >2013-12-04 10:26:44,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 59c0e2da >2013-12-04 10:26:44,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36a3d7de >2013-12-04 10:26:44,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c376641, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e306732d}, log id: 36a3d7de >2013-12-04 10:26:49,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b7ba921 >2013-12-04 10:26:50,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2b7ba921 >2013-12-04 10:26:50,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 48db8cce >2013-12-04 10:26:50,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2b78a2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df6c82f0}, log id: 48db8cce >2013-12-04 10:26:55,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6dd2b72d >2013-12-04 10:26:55,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6dd2b72d >2013-12-04 10:26:55,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 434a697 >2013-12-04 10:26:56,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad603a22, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e312d03}, log id: 434a697 >2013-12-04 10:27:01,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 72a39ed3 >2013-12-04 10:27:01,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 72a39ed3 >2013-12-04 10:27:01,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e89184d >2013-12-04 10:27:01,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7eb48939, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@871e2c7b}, log id: 7e89184d >2013-12-04 10:27:06,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: f1a38bf >2013-12-04 10:27:07,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: f1a38bf >2013-12-04 10:27:07,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70e623f >2013-12-04 10:27:07,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@209e0468, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@763f35d3}, log id: 70e623f >2013-12-04 10:27:08,869 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-04 10:27:08,882 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:27:08,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6dc5222e >2013-12-04 10:27:09,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6dc5222e >2013-12-04 10:27:12,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 52e4788c >2013-12-04 10:27:13,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 52e4788c >2013-12-04 10:27:13,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 314cc00b >2013-12-04 10:27:13,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab32316c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be79bd18}, log id: 314cc00b >2013-12-04 10:27:18,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: a6e8b03 >2013-12-04 10:27:19,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: a6e8b03 >2013-12-04 10:27:19,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: d9a7d98 >2013-12-04 10:27:19,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee35ebbb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d5d758}, log id: d9a7d98 >2013-12-04 10:27:24,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2107c925 >2013-12-04 10:27:24,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2107c925 >2013-12-04 10:27:24,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c2f67bd >2013-12-04 10:27:25,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a914d1a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80dd0a64}, log id: 5c2f67bd >2013-12-04 10:27:30,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7446b296 >2013-12-04 10:27:30,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7446b296 >2013-12-04 10:27:30,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 24175812 >2013-12-04 10:27:31,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fbc0c7f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18e02cd}, log id: 24175812 >2013-12-04 10:27:36,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7e7cbb4c >2013-12-04 10:27:36,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e7cbb4c >2013-12-04 10:27:36,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 38585826 >2013-12-04 10:27:36,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b10766c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2b70017}, log id: 38585826 >2013-12-04 10:27:41,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 19352821 >2013-12-04 10:27:42,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 19352821 >2013-12-04 10:27:42,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b235222 >2013-12-04 10:27:42,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@862afb58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a0d78cd}, log id: 4b235222 >2013-12-04 10:27:47,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1890c0db >2013-12-04 10:27:48,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1890c0db >2013-12-04 10:27:48,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7de6c810 >2013-12-04 10:27:48,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee944d01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c29d6b46}, log id: 7de6c810 >2013-12-04 10:27:53,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14a00dea >2013-12-04 10:27:54,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 14a00dea >2013-12-04 10:27:54,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59620e8f >2013-12-04 10:27:54,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ee6db73, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae11a2}, log id: 59620e8f >2013-12-04 10:27:59,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3fe0ffc9 >2013-12-04 10:27:59,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3fe0ffc9 >2013-12-04 10:27:59,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c875124 >2013-12-04 10:28:00,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13be9633, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98cdd335}, log id: 4c875124 >2013-12-04 10:28:05,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 226f6b08 >2013-12-04 10:28:05,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 226f6b08 >2013-12-04 10:28:05,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2533dc19 >2013-12-04 10:28:05,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@330d75aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@224e587a}, log id: 2533dc19 >2013-12-04 10:28:09,191 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-04 10:28:09,200 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:28:09,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 48691a95 >2013-12-04 10:28:09,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 48691a95 >2013-12-04 10:28:10,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78bcfd42 >2013-12-04 10:28:11,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 78bcfd42 >2013-12-04 10:28:11,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4fa38905 >2013-12-04 10:28:11,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6087f075, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4ec88f2}, log id: 4fa38905 >2013-12-04 10:28:16,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59b1cd40 >2013-12-04 10:28:17,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 59b1cd40 >2013-12-04 10:28:17,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7333f43b >2013-12-04 10:28:17,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bff851ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f781399}, log id: 7333f43b >2013-12-04 10:28:22,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 207798fb >2013-12-04 10:28:23,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 207798fb >2013-12-04 10:28:23,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c10f464 >2013-12-04 10:28:23,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@879ba27e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b27a7c2c}, log id: 1c10f464 >2013-12-04 10:28:28,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43b06b24 >2013-12-04 10:28:28,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 43b06b24 >2013-12-04 10:28:28,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 16eeb100 >2013-12-04 10:28:29,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcbd8a45, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d26510bd}, log id: 16eeb100 >2013-12-04 10:28:34,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5139905d >2013-12-04 10:28:34,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5139905d >2013-12-04 10:28:34,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 91c43c9 >2013-12-04 10:28:34,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7044f27, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92877153}, log id: 91c43c9 >2013-12-04 10:28:39,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 195920d0 >2013-12-04 10:28:40,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 195920d0 >2013-12-04 10:28:40,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7cd36f53 >2013-12-04 10:28:40,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57c18c2c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72a179a6}, log id: 7cd36f53 >2013-12-04 10:28:45,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 64a469e2 >2013-12-04 10:28:46,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 64a469e2 >2013-12-04 10:28:46,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 677e5ea9 >2013-12-04 10:28:46,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bed62b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7f02d95}, log id: 677e5ea9 >2013-12-04 10:28:51,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1020c076 >2013-12-04 10:28:52,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1020c076 >2013-12-04 10:28:52,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a3b1e0e >2013-12-04 10:28:52,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9159da3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f707c4e}, log id: 5a3b1e0e >2013-12-04 10:28:57,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3aeadf08 >2013-12-04 10:28:57,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3aeadf08 >2013-12-04 10:28:57,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 58dadcf >2013-12-04 10:28:58,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92d6a74e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f043699}, log id: 58dadcf >2013-12-04 10:29:03,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 77f862d5 >2013-12-04 10:29:03,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 77f862d5 >2013-12-04 10:29:03,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fdee77a >2013-12-04 10:29:03,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea32482c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@400c3a4c}, log id: 2fdee77a >2013-12-04 10:29:08,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c550cdf >2013-12-04 10:29:09,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5c550cdf >2013-12-04 10:29:09,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e71c439 >2013-12-04 10:29:09,512 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) [e67de57] No up server in cluster >2013-12-04 10:29:09,512 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) [e67de57] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:29:09,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: f30b3a >2013-12-04 10:29:09,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f891843f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d32dfbe}, log id: 2e71c439 >2013-12-04 10:29:09,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterTasksListVDSCommand, return: [], log id: f30b3a >2013-12-04 10:29:14,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 89c6f8f >2013-12-04 10:29:15,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 89c6f8f >2013-12-04 10:29:15,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1944a1aa >2013-12-04 10:29:15,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1144ec80, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd6e89fa}, log id: 1944a1aa >2013-12-04 10:29:20,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 15034b79 >2013-12-04 10:29:21,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 15034b79 >2013-12-04 10:29:21,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 27cdec89 >2013-12-04 10:29:21,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47e7ae36, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efb7a112}, log id: 27cdec89 >2013-12-04 10:29:26,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6e8c0aa3 >2013-12-04 10:29:26,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e8c0aa3 >2013-12-04 10:29:26,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 70fb3d0 >2013-12-04 10:29:27,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37165db5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7b781a3}, log id: 70fb3d0 >2013-12-04 10:29:32,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28f52f50 >2013-12-04 10:29:32,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 28f52f50 >2013-12-04 10:29:32,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 518d3045 >2013-12-04 10:29:33,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7867d60b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d35c3fe6}, log id: 518d3045 >2013-12-04 10:29:38,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4f10be93 >2013-12-04 10:29:38,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f10be93 >2013-12-04 10:29:38,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: e386a60 >2013-12-04 10:29:38,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a20706b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a919a8}, log id: e386a60 >2013-12-04 10:29:41,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50ad8fd5 >2013-12-04 10:29:41,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@50b4d7ae, log id: 50ad8fd5 >2013-12-04 10:29:41,634 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-32) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:29:41,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10bc09e7 >2013-12-04 10:29:41,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2a0b4a7a, log id: 10bc09e7 >2013-12-04 10:29:43,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45a9c4cc >2013-12-04 10:29:44,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 45a9c4cc >2013-12-04 10:29:44,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 52b339ca >2013-12-04 10:29:44,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7afcbbe1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95310393}, log id: 52b339ca >2013-12-04 10:29:49,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 53024656 >2013-12-04 10:29:50,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 53024656 >2013-12-04 10:29:50,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a839394 >2013-12-04 10:29:50,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99b2873a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c533703}, log id: 7a839394 >2013-12-04 10:29:55,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3b8e73e6 >2013-12-04 10:29:56,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b8e73e6 >2013-12-04 10:29:56,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 443ac5a2 >2013-12-04 10:29:56,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fac3cfa7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@851bfe61}, log id: 443ac5a2 >2013-12-04 10:30:01,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 57f189fa >2013-12-04 10:30:01,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 57f189fa >2013-12-04 10:30:01,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 208f5995 >2013-12-04 10:30:02,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@983deb1d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18123858}, log id: 208f5995 >2013-12-04 10:30:07,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 422518ee >2013-12-04 10:30:07,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 422518ee >2013-12-04 10:30:07,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7df6dead >2013-12-04 10:30:08,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a43dda0b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2e8e41d}, log id: 7df6dead >2013-12-04 10:30:09,815 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) No up server in cluster >2013-12-04 10:30:09,815 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:30:09,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ae892a0 >2013-12-04 10:30:10,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4ae892a0 >2013-12-04 10:30:13,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 79fcf742 >2013-12-04 10:30:13,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 79fcf742 >2013-12-04 10:30:13,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 18773609 >2013-12-04 10:30:13,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48d5b182, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3515560}, log id: 18773609 >2013-12-04 10:30:18,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1946d571 >2013-12-04 10:30:19,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1946d571 >2013-12-04 10:30:19,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: f423b8d >2013-12-04 10:30:19,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8bf0aa1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@173c1895}, log id: f423b8d >2013-12-04 10:30:24,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30d9f39c >2013-12-04 10:30:25,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 30d9f39c >2013-12-04 10:30:25,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1cfbfb9d >2013-12-04 10:30:25,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12211fe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9887ba0c}, log id: 1cfbfb9d >2013-12-04 10:30:30,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 13436bc2 >2013-12-04 10:30:30,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 13436bc2 >2013-12-04 10:30:30,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66834da6 >2013-12-04 10:30:31,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f85aed52, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b0ee679}, log id: 66834da6 >2013-12-04 10:30:36,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69e6d2b8 >2013-12-04 10:30:36,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 69e6d2b8 >2013-12-04 10:30:36,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e7b5010 >2013-12-04 10:30:37,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bfe0491, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@213551b2}, log id: 3e7b5010 >2013-12-04 10:30:42,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3dc9e5a7 >2013-12-04 10:30:42,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3dc9e5a7 >2013-12-04 10:30:42,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37df6c8c >2013-12-04 10:30:42,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56561261, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8ca73bd}, log id: 37df6c8c >2013-12-04 10:30:47,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69212eb5 >2013-12-04 10:30:48,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 69212eb5 >2013-12-04 10:30:48,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 8f84350 >2013-12-04 10:30:48,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92715514, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb59f266}, log id: 8f84350 >2013-12-04 10:30:53,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 348a26b >2013-12-04 10:30:54,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 348a26b >2013-12-04 10:30:54,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 31dc9b95 >2013-12-04 10:30:54,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b8292c7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc6c1c0d}, log id: 31dc9b95 >2013-12-04 10:30:59,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 8c5a9fc >2013-12-04 10:31:00,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 8c5a9fc >2013-12-04 10:31:00,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ade8eb3 >2013-12-04 10:31:00,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2994fed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5bf460c}, log id: ade8eb3 >2013-12-04 10:31:05,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63797d31 >2013-12-04 10:31:05,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 63797d31 >2013-12-04 10:31:05,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6beaff08 >2013-12-04 10:31:06,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@942deea4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abcadeac}, log id: 6beaff08 >2013-12-04 10:31:10,140 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-04 10:31:10,153 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:31:10,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54775a01 >2013-12-04 10:31:10,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 54775a01 >2013-12-04 10:31:11,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3eebb648 >2013-12-04 10:31:11,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3eebb648 >2013-12-04 10:31:11,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8632a72 >2013-12-04 10:31:11,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88bc361e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd9d0b64}, log id: 8632a72 >2013-12-04 10:31:16,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6eeaa5b9 >2013-12-04 10:31:17,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6eeaa5b9 >2013-12-04 10:31:17,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6539cf76 >2013-12-04 10:31:17,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3df06465, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b5363a3}, log id: 6539cf76 >2013-12-04 10:31:22,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 340fb38a >2013-12-04 10:31:23,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 340fb38a >2013-12-04 10:31:23,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5663bc4d >2013-12-04 10:31:23,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82085fe9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84ec678c}, log id: 5663bc4d >2013-12-04 10:31:28,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5600da64 >2013-12-04 10:31:29,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5600da64 >2013-12-04 10:31:29,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a26c733 >2013-12-04 10:31:29,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75126785, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98e80208}, log id: 1a26c733 >2013-12-04 10:31:34,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 69db828d >2013-12-04 10:31:35,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 69db828d >2013-12-04 10:31:35,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3aa13a3 >2013-12-04 10:31:35,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54c500b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c36857c7}, log id: 3aa13a3 >2013-12-04 10:31:40,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5095bec5 >2013-12-04 10:31:40,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5095bec5 >2013-12-04 10:31:40,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2324f283 >2013-12-04 10:31:41,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83b6eec3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54e8e655}, log id: 2324f283 >2013-12-04 10:31:46,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d860412 >2013-12-04 10:31:46,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4d860412 >2013-12-04 10:31:46,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5920856c >2013-12-04 10:31:46,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20c00800, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42068e99}, log id: 5920856c >2013-12-04 10:31:52,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7c2ad6b3 >2013-12-04 10:31:52,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7c2ad6b3 >2013-12-04 10:31:52,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: de8e7be >2013-12-04 10:31:52,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acea224d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b60f8508}, log id: de8e7be >2013-12-04 10:31:57,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 9f57352 >2013-12-04 10:31:58,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 9f57352 >2013-12-04 10:31:58,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4eb9ae44 >2013-12-04 10:31:58,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5bfef52, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8869b7d}, log id: 4eb9ae44 >2013-12-04 10:32:03,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ac2b453 >2013-12-04 10:32:04,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6ac2b453 >2013-12-04 10:32:04,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3383aab9 >2013-12-04 10:32:04,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eea5f4b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d39e16dd}, log id: 3383aab9 >2013-12-04 10:32:09,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76b89f69 >2013-12-04 10:32:09,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 76b89f69 >2013-12-04 10:32:09,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5636c23e >2013-12-04 10:32:10,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2da7588, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab541c01}, log id: 5636c23e >2013-12-04 10:32:10,437 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-04 10:32:10,437 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:32:10,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b56a67e >2013-12-04 10:32:10,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2b56a67e >2013-12-04 10:32:15,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22ad5571 >2013-12-04 10:32:15,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 22ad5571 >2013-12-04 10:32:15,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34466fbb >2013-12-04 10:32:16,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e69793c7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b734912}, log id: 34466fbb >2013-12-04 10:32:21,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 193fb7f8 >2013-12-04 10:32:21,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 193fb7f8 >2013-12-04 10:32:21,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45c2a1c2 >2013-12-04 10:32:21,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21838531, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2634e14b}, log id: 45c2a1c2 >2013-12-04 10:32:26,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 60ccf1d6 >2013-12-04 10:32:27,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 60ccf1d6 >2013-12-04 10:32:27,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 343136f7 >2013-12-04 10:32:27,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b018d078, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dbceea}, log id: 343136f7 >2013-12-04 10:32:32,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70bdb4b5 >2013-12-04 10:32:33,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 70bdb4b5 >2013-12-04 10:32:33,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6fa0d64 >2013-12-04 10:32:33,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91b07d7b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6facc39f}, log id: 6fa0d64 >2013-12-04 10:32:38,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2c29b508 >2013-12-04 10:32:39,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2c29b508 >2013-12-04 10:32:39,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15f1dd3a >2013-12-04 10:32:39,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74ec8665, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1f2edbf}, log id: 15f1dd3a >2013-12-04 10:32:44,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5fca198 >2013-12-04 10:32:44,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5fca198 >2013-12-04 10:32:44,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e836917 >2013-12-04 10:32:45,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4e6ba5f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e10af3d1}, log id: 2e836917 >2013-12-04 10:32:50,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ac558d1 >2013-12-04 10:32:50,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7ac558d1 >2013-12-04 10:32:50,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 13f35898 >2013-12-04 10:32:50,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95f13afc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38b00957}, log id: 13f35898 >2013-12-04 10:32:55,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4fb1b16e >2013-12-04 10:32:56,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4fb1b16e >2013-12-04 10:32:56,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1e676ac5 >2013-12-04 10:32:56,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5f309f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a6865ca}, log id: 1e676ac5 >2013-12-04 10:33:01,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 24eae83a >2013-12-04 10:33:02,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 24eae83a >2013-12-04 10:33:02,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e26bfa8 >2013-12-04 10:33:02,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b533fdd7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44f0b4b3}, log id: 6e26bfa8 >2013-12-04 10:33:07,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 27faf320 >2013-12-04 10:33:08,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 27faf320 >2013-12-04 10:33:08,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7832601 >2013-12-04 10:33:08,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83595497, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea23ea95}, log id: 7832601 >2013-12-04 10:33:10,740 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-04 10:33:10,757 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:33:10,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7d7da44b >2013-12-04 10:33:11,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7d7da44b >2013-12-04 10:33:13,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 36ffde1a >2013-12-04 10:33:13,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36ffde1a >2013-12-04 10:33:13,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 77ea701d >2013-12-04 10:33:14,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a22b4acc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6116a92}, log id: 77ea701d >2013-12-04 10:33:19,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2953e1ca >2013-12-04 10:33:19,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2953e1ca >2013-12-04 10:33:19,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: bb7df20 >2013-12-04 10:33:20,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62c9d724, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a672c591}, log id: bb7df20 >2013-12-04 10:33:25,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 796ceb1 >2013-12-04 10:33:25,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 796ceb1 >2013-12-04 10:33:25,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d11e4e1 >2013-12-04 10:33:25,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32cb96b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@557d4932}, log id: 5d11e4e1 >2013-12-04 10:33:30,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 206c0fcc >2013-12-04 10:33:31,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 206c0fcc >2013-12-04 10:33:31,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ac5792f >2013-12-04 10:33:31,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@768b0c38, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@879767c3}, log id: 3ac5792f >2013-12-04 10:33:36,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 61bcf221 >2013-12-04 10:33:37,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 61bcf221 >2013-12-04 10:33:37,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ec50cbe >2013-12-04 10:33:37,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5db3e515, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8c83e8a}, log id: 1ec50cbe >2013-12-04 10:33:42,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5aba7aea >2013-12-04 10:33:43,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5aba7aea >2013-12-04 10:33:43,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7f13951b >2013-12-04 10:33:43,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2733a23, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8350f00}, log id: 7f13951b >2013-12-04 10:33:48,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4e936386 >2013-12-04 10:33:48,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e936386 >2013-12-04 10:33:48,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 44933551 >2013-12-04 10:33:49,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@900dfb81, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@414627b3}, log id: 44933551 >2013-12-04 10:33:54,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1f526dcc >2013-12-04 10:33:54,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f526dcc >2013-12-04 10:33:54,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 14a7c0a0 >2013-12-04 10:33:54,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98db3c59, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6d614c6}, log id: 14a7c0a0 >2013-12-04 10:33:59,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1118b4ad >2013-12-04 10:34:00,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1118b4ad >2013-12-04 10:34:00,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2f13b0ec >2013-12-04 10:34:00,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0b5b242, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b614724}, log id: 2f13b0ec >2013-12-04 10:34:05,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ef637c0 >2013-12-04 10:34:06,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4ef637c0 >2013-12-04 10:34:06,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 66ff53cc >2013-12-04 10:34:06,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bead8ad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1921b019}, log id: 66ff53cc >2013-12-04 10:34:11,069 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) No up server in cluster >2013-12-04 10:34:11,071 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:34:11,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 768cca53 >2013-12-04 10:34:11,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, return: [], log id: 768cca53 >2013-12-04 10:34:11,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1dc85a16 >2013-12-04 10:34:12,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1dc85a16 >2013-12-04 10:34:12,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4efc1238 >2013-12-04 10:34:12,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d1d11fa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bfaf574}, log id: 4efc1238 >2013-12-04 10:34:17,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 57ce8eb6 >2013-12-04 10:34:17,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 57ce8eb6 >2013-12-04 10:34:17,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2e393fde >2013-12-04 10:34:18,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c86a7d8f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@745ea1ac}, log id: 2e393fde >2013-12-04 10:34:23,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 225ab1c1 >2013-12-04 10:34:23,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 225ab1c1 >2013-12-04 10:34:23,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ab07f16 >2013-12-04 10:34:23,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2f342a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6970468}, log id: ab07f16 >2013-12-04 10:34:28,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f490c67 >2013-12-04 10:34:29,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f490c67 >2013-12-04 10:34:29,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e5b7486 >2013-12-04 10:34:29,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d09756d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18afed91}, log id: 7e5b7486 >2013-12-04 10:34:34,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 8e3f735 >2013-12-04 10:34:35,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 8e3f735 >2013-12-04 10:34:35,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 35858613 >2013-12-04 10:34:35,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7aea240, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb83b51e}, log id: 35858613 >2013-12-04 10:34:40,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 257e3d24 >2013-12-04 10:34:41,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 257e3d24 >2013-12-04 10:34:41,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 351c55c1 >2013-12-04 10:34:41,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52c79c0b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3915cba}, log id: 351c55c1 >2013-12-04 10:34:41,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 50a75c58 >2013-12-04 10:34:42,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4fd00971, log id: 50a75c58 >2013-12-04 10:34:42,227 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-8) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:34:42,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 631c02a6 >2013-12-04 10:34:42,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@74f271db, log id: 631c02a6 >2013-12-04 10:34:46,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f7293dc >2013-12-04 10:34:46,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f7293dc >2013-12-04 10:34:46,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b92bece >2013-12-04 10:34:47,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aefbb7e6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40e0b2dc}, log id: 3b92bece >2013-12-04 10:34:52,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: dea15a8 >2013-12-04 10:34:52,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: dea15a8 >2013-12-04 10:34:52,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f7f6690 >2013-12-04 10:34:52,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88407373, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2651e36}, log id: 3f7f6690 >2013-12-04 10:34:58,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 18e68a29 >2013-12-04 10:34:58,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 18e68a29 >2013-12-04 10:34:58,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7457cf63 >2013-12-04 10:34:58,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@482a12ae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6576198f}, log id: 7457cf63 >2013-12-04 10:35:03,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3071194a >2013-12-04 10:35:04,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3071194a >2013-12-04 10:35:04,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5d10ddf6 >2013-12-04 10:35:04,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5fd19b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d979cb5}, log id: 5d10ddf6 >2013-12-04 10:35:09,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16b7c54 >2013-12-04 10:35:10,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 16b7c54 >2013-12-04 10:35:10,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e2a4976 >2013-12-04 10:35:10,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffc9eccb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@863b70f7}, log id: 1e2a4976 >2013-12-04 10:35:11,361 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-04 10:35:11,363 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:35:11,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f6226f8 >2013-12-04 10:35:11,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4f6226f8 >2013-12-04 10:35:15,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2c283981 >2013-12-04 10:35:15,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c283981 >2013-12-04 10:35:15,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 46a21cdd >2013-12-04 10:35:16,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64f07458, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca48268d}, log id: 46a21cdd >2013-12-04 10:35:21,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38a481c7 >2013-12-04 10:35:21,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 38a481c7 >2013-12-04 10:35:21,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3727935b >2013-12-04 10:35:22,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e12872b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7d01a4b}, log id: 3727935b >2013-12-04 10:35:27,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1062dfbc >2013-12-04 10:35:27,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1062dfbc >2013-12-04 10:35:27,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d51a758 >2013-12-04 10:35:27,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a384e768, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9082d7af}, log id: 4d51a758 >2013-12-04 10:35:32,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 566ccd36 >2013-12-04 10:35:33,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 566ccd36 >2013-12-04 10:35:33,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1e6881e0 >2013-12-04 10:35:33,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb2f328e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e37389}, log id: 1e6881e0 >2013-12-04 10:35:38,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57436043 >2013-12-04 10:35:39,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 57436043 >2013-12-04 10:35:39,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 255a4500 >2013-12-04 10:35:39,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2fa721f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ed80ef3}, log id: 255a4500 >2013-12-04 10:35:44,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3bc25290 >2013-12-04 10:35:45,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3bc25290 >2013-12-04 10:35:45,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 17684278 >2013-12-04 10:35:45,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed297eed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f7af9e7}, log id: 17684278 >2013-12-04 10:35:50,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 491f4157 >2013-12-04 10:35:50,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 491f4157 >2013-12-04 10:35:50,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30fd5e81 >2013-12-04 10:35:51,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc6f4ff0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4c045d2}, log id: 30fd5e81 >2013-12-04 10:35:56,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30a232bf >2013-12-04 10:35:56,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 30a232bf >2013-12-04 10:35:56,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56e350a4 >2013-12-04 10:35:57,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2683a25, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74257068}, log id: 56e350a4 >2013-12-04 10:36:02,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6ff55ed8 >2013-12-04 10:36:02,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ff55ed8 >2013-12-04 10:36:02,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 280dad0f >2013-12-04 10:36:02,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@563e9ef1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e031bc1}, log id: 280dad0f >2013-12-04 10:36:07,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6782bcb9 >2013-12-04 10:36:08,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6782bcb9 >2013-12-04 10:36:08,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22e4c213 >2013-12-04 10:36:08,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6f72e03, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4e38bd1}, log id: 22e4c213 >2013-12-04 10:36:11,653 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-04 10:36:11,653 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:36:11,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63702747 >2013-12-04 10:36:11,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 63702747 >2013-12-04 10:36:13,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6932b561 >2013-12-04 10:36:14,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6932b561 >2013-12-04 10:36:14,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 52301e3 >2013-12-04 10:36:14,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2e69dd2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1298a9f8}, log id: 52301e3 >2013-12-04 10:36:19,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4880419 >2013-12-04 10:36:20,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4880419 >2013-12-04 10:36:20,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6d1f60f3 >2013-12-04 10:36:20,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43a99ada, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed9a8945}, log id: 6d1f60f3 >2013-12-04 10:36:25,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4445cf24 >2013-12-04 10:36:25,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4445cf24 >2013-12-04 10:36:25,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2ddb06be >2013-12-04 10:36:26,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e76d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2ed0bd7}, log id: 2ddb06be >2013-12-04 10:36:31,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12c4ada0 >2013-12-04 10:36:31,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 12c4ada0 >2013-12-04 10:36:31,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c925f9e >2013-12-04 10:36:32,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c25cd519, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38491e16}, log id: c925f9e >2013-12-04 10:36:37,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f9fc2f5 >2013-12-04 10:36:37,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5f9fc2f5 >2013-12-04 10:36:37,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70f8a4b1 >2013-12-04 10:36:37,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85b36f07, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@884ef169}, log id: 70f8a4b1 >2013-12-04 10:36:42,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f256e88 >2013-12-04 10:36:43,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1f256e88 >2013-12-04 10:36:43,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5e50d50b >2013-12-04 10:36:43,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@489c212d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1eaadc}, log id: 5e50d50b >2013-12-04 10:36:48,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 42ed33f2 >2013-12-04 10:36:49,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 42ed33f2 >2013-12-04 10:36:49,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6d48e4ae >2013-12-04 10:36:49,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a16887c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f881dab0}, log id: 6d48e4ae >2013-12-04 10:36:54,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a12bc38 >2013-12-04 10:36:55,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a12bc38 >2013-12-04 10:36:55,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20454a6d >2013-12-04 10:36:55,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@879aed31, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@672ec134}, log id: 20454a6d >2013-12-04 10:37:00,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6fbf2e8f >2013-12-04 10:37:00,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6fbf2e8f >2013-12-04 10:37:00,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1322b720 >2013-12-04 10:37:01,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d7e3e73, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1ea5e7a}, log id: 1322b720 >2013-12-04 10:37:06,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 37bc462f >2013-12-04 10:37:06,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 37bc462f >2013-12-04 10:37:06,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6396279a >2013-12-04 10:37:06,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63503742, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc5711d}, log id: 6396279a >2013-12-04 10:37:11,949 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) [3f45b52d] No up server in cluster >2013-12-04 10:37:11,964 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) [3f45b52d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:37:11,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57fa8a9c >2013-12-04 10:37:12,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18256c32 >2013-12-04 10:37:12,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 57fa8a9c >2013-12-04 10:37:12,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 18256c32 >2013-12-04 10:37:12,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d7af084 >2013-12-04 10:37:12,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cad7f67a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42ff0139}, log id: 2d7af084 >2013-12-04 10:37:17,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1d4f7448 >2013-12-04 10:37:18,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1d4f7448 >2013-12-04 10:37:18,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ff36ac5 >2013-12-04 10:37:18,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@660f3da4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61152372}, log id: 2ff36ac5 >2013-12-04 10:37:23,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 69fcf854 >2013-12-04 10:37:24,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 69fcf854 >2013-12-04 10:37:24,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 10474a3c >2013-12-04 10:37:24,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfcdccc3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef0bbcdf}, log id: 10474a3c >2013-12-04 10:37:29,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1ab5b131 >2013-12-04 10:37:29,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ab5b131 >2013-12-04 10:37:29,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3eeb6633 >2013-12-04 10:37:30,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6ca71cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@716b7374}, log id: 3eeb6633 >2013-12-04 10:37:35,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 339c44aa >2013-12-04 10:37:35,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 339c44aa >2013-12-04 10:37:35,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 727ffd77 >2013-12-04 10:37:36,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e919f9d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4d68b06}, log id: 727ffd77 >2013-12-04 10:37:41,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 16840c8b >2013-12-04 10:37:41,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 16840c8b >2013-12-04 10:37:41,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f81414e >2013-12-04 10:37:41,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c481d35, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5746fd7}, log id: 5f81414e >2013-12-04 10:37:46,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 31970f61 >2013-12-04 10:37:47,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 31970f61 >2013-12-04 10:37:47,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d2f42d7 >2013-12-04 10:37:47,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@856be4be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@364f3b21}, log id: 5d2f42d7 >2013-12-04 10:37:52,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 69285d4f >2013-12-04 10:37:53,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 69285d4f >2013-12-04 10:37:53,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 426320b6 >2013-12-04 10:37:53,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@717428a0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32e81be7}, log id: 426320b6 >2013-12-04 10:37:58,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b66d35e >2013-12-04 10:37:59,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b66d35e >2013-12-04 10:37:59,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d573426 >2013-12-04 10:37:59,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97abc792, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4fa0818}, log id: 1d573426 >2013-12-04 10:38:04,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69377f09 >2013-12-04 10:38:04,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 69377f09 >2013-12-04 10:38:04,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 330b28af >2013-12-04 10:38:05,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83b67567, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed5d3cee}, log id: 330b28af >2013-12-04 10:38:10,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7755a0bc >2013-12-04 10:38:10,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7755a0bc >2013-12-04 10:38:10,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ff2aa0e >2013-12-04 10:38:10,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f197a8e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@657e6e75}, log id: 2ff2aa0e >2013-12-04 10:38:12,289 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) [7973d44b] No up server in cluster >2013-12-04 10:38:12,291 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) [7973d44b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:38:12,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 50c7f5d >2013-12-04 10:38:12,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterTasksListVDSCommand, return: [], log id: 50c7f5d >2013-12-04 10:38:15,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b6e58f1 >2013-12-04 10:38:16,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b6e58f1 >2013-12-04 10:38:16,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3002c03a >2013-12-04 10:38:16,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@652678f4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdfb8754}, log id: 3002c03a >2013-12-04 10:38:21,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2cf8bcf4 >2013-12-04 10:38:22,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2cf8bcf4 >2013-12-04 10:38:22,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4bba124b >2013-12-04 10:38:22,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f336d1ff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee409d2}, log id: 4bba124b >2013-12-04 10:38:27,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3ae4fa95 >2013-12-04 10:38:28,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3ae4fa95 >2013-12-04 10:38:28,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3368ccd6 >2013-12-04 10:38:28,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82db35d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7eb1367}, log id: 3368ccd6 >2013-12-04 10:38:33,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5da55a42 >2013-12-04 10:38:33,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5da55a42 >2013-12-04 10:38:33,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2f9d8156 >2013-12-04 10:38:34,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70660a0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21e46f86}, log id: 2f9d8156 >2013-12-04 10:38:36,914 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VMs/Templates Ovf. >2013-12-04 10:38:37,042 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-9) Start refreshing all users data >2013-12-04 10:38:39,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 535f5471 >2013-12-04 10:38:39,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-16) START, GlusterHooksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6aa4d180 >2013-12-04 10:38:39,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-30) START, GlusterHooksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4bc5de48 >2013-12-04 10:38:39,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-16) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@9bcffa35, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5af0ad79, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@1c00605c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ee26478d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@751890ed, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@29703946, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f63146ff], log id: 6aa4d180 >2013-12-04 10:38:39,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-42) START, GlusterHooksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 508aad88 >2013-12-04 10:38:39,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-42) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@e56e790, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@834b4cbe, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@cd4a2363, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a339b99a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3f097226, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3f9abd3a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6d4b54dd], log id: 508aad88 >2013-12-04 10:38:39,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-25) START, GlusterHooksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: a694bcf >2013-12-04 10:38:39,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-25) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@85460dad, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@32f8f373, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c898a8ae, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@854613cc, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ab890017, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@7a5244b1, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f14a7355], log id: a694bcf >2013-12-04 10:38:39,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-30) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@579afcab, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@36ccf6ff, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@633a8d91, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4c43c794, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ff5622ee, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@496dce8e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6a5b5749], log id: 4bc5de48 >2013-12-04 10:38:39,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 535f5471 >2013-12-04 10:38:39,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30d00aac >2013-12-04 10:38:40,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b3fea72, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@921c40d2}, log id: 30d00aac >2013-12-04 10:38:45,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7c8dc7cf >2013-12-04 10:38:45,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7c8dc7cf >2013-12-04 10:38:45,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4479801f >2013-12-04 10:38:45,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8638c1fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a12a7316}, log id: 4479801f >2013-12-04 10:38:50,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 793c75cc >2013-12-04 10:38:51,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 793c75cc >2013-12-04 10:38:51,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f7fab93 >2013-12-04 10:38:51,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@153d53d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@134a443b}, log id: 5f7fab93 >2013-12-04 10:38:56,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f352283 >2013-12-04 10:38:57,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1f352283 >2013-12-04 10:38:57,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7d1f2be9 >2013-12-04 10:38:57,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c766b687, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7968c22}, log id: 7d1f2be9 >2013-12-04 10:39:02,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7f3d844c >2013-12-04 10:39:02,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7f3d844c >2013-12-04 10:39:03,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6a5b0b1e >2013-12-04 10:39:03,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9e34c94, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32d9bda9}, log id: 6a5b0b1e >2013-12-04 10:39:08,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: c798d8 >2013-12-04 10:39:08,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: c798d8 >2013-12-04 10:39:08,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3c9d373d >2013-12-04 10:39:09,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1212dbf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@187141fb}, log id: 3c9d373d >2013-12-04 10:39:12,602 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) No up server in cluster >2013-12-04 10:39:12,611 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:39:12,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3a4d74d6 >2013-12-04 10:39:12,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3a4d74d6 >2013-12-04 10:39:14,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 64a4f04f >2013-12-04 10:39:14,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 64a4f04f >2013-12-04 10:39:14,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a774d85 >2013-12-04 10:39:14,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffb112e6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1f553e5}, log id: a774d85 >2013-12-04 10:39:19,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b6b4696 >2013-12-04 10:39:20,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4b6b4696 >2013-12-04 10:39:20,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 21e8ce6d >2013-12-04 10:39:20,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61aa5283, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f99c70b}, log id: 21e8ce6d >2013-12-04 10:39:25,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74cfa2b7 >2013-12-04 10:39:26,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 74cfa2b7 >2013-12-04 10:39:26,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41202bef >2013-12-04 10:39:26,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fef7deb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c7af6b5}, log id: 41202bef >2013-12-04 10:39:31,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5a3e8da4 >2013-12-04 10:39:32,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5a3e8da4 >2013-12-04 10:39:32,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1659816c >2013-12-04 10:39:32,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20c9ec11, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9afc39be}, log id: 1659816c >2013-12-04 10:39:37,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c0b95ed >2013-12-04 10:39:37,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6c0b95ed >2013-12-04 10:39:37,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a3c9ae2 >2013-12-04 10:39:38,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9eb571b1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d5b6247}, log id: 5a3c9ae2 >2013-12-04 10:39:42,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 329dfa19 >2013-12-04 10:39:42,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@67a43e3f, log id: 329dfa19 >2013-12-04 10:39:42,842 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-68) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:39:42,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ff2cf41 >2013-12-04 10:39:43,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@601d346d, log id: 4ff2cf41 >2013-12-04 10:39:43,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 238f56f4 >2013-12-04 10:39:43,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 238f56f4 >2013-12-04 10:39:43,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53ad754 >2013-12-04 10:39:43,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71ca77f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5b2adb4}, log id: 53ad754 >2013-12-04 10:39:49,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3fbb7dda >2013-12-04 10:39:49,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fbb7dda >2013-12-04 10:39:49,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 65ee5f8e >2013-12-04 10:39:49,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a36488a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61b2012d}, log id: 65ee5f8e >2013-12-04 10:39:54,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 603c225c >2013-12-04 10:39:55,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 603c225c >2013-12-04 10:39:55,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2714fbc9 >2013-12-04 10:39:55,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fec24599, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ea3e032}, log id: 2714fbc9 >2013-12-04 10:40:00,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c02963a >2013-12-04 10:40:01,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1c02963a >2013-12-04 10:40:01,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6601cbc3 >2013-12-04 10:40:01,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fdbce67, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@463aff1f}, log id: 6601cbc3 >2013-12-04 10:40:06,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39f1f9f9 >2013-12-04 10:40:07,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 39f1f9f9 >2013-12-04 10:40:07,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77ab8ff6 >2013-12-04 10:40:07,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5349f095, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c009c12}, log id: 77ab8ff6 >2013-12-04 10:40:12,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40984eb5 >2013-12-04 10:40:12,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 40984eb5 >2013-12-04 10:40:12,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1152e37a >2013-12-04 10:40:12,916 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-04 10:40:12,916 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:40:12,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 13d78282 >2013-12-04 10:40:13,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ad3509c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14937698}, log id: 1152e37a >2013-12-04 10:40:13,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 13d78282 >2013-12-04 10:40:18,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2f4e9d68 >2013-12-04 10:40:18,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f4e9d68 >2013-12-04 10:40:18,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 9fd1844 >2013-12-04 10:40:18,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@910ab24f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@584ff201}, log id: 9fd1844 >2013-12-04 10:40:23,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 20646991 >2013-12-04 10:40:24,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 20646991 >2013-12-04 10:40:24,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2aac3793 >2013-12-04 10:40:24,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bce0e504, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af7d4415}, log id: 2aac3793 >2013-12-04 10:40:29,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 42fceae1 >2013-12-04 10:40:30,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 42fceae1 >2013-12-04 10:40:30,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12e2af7b >2013-12-04 10:40:30,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@371fd94, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3159443}, log id: 12e2af7b >2013-12-04 10:40:35,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15fe982b >2013-12-04 10:40:36,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 15fe982b >2013-12-04 10:40:36,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 667c372c >2013-12-04 10:40:36,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd65f50b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2afdfcab}, log id: 667c372c >2013-12-04 10:40:41,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5913e685 >2013-12-04 10:40:41,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5913e685 >2013-12-04 10:40:41,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 72fdd427 >2013-12-04 10:40:42,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1aee1b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61fd66c}, log id: 72fdd427 >2013-12-04 10:40:47,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4af167f8 >2013-12-04 10:40:47,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4af167f8 >2013-12-04 10:40:47,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3ee2d54c >2013-12-04 10:40:48,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d680ea6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e931764}, log id: 3ee2d54c >2013-12-04 10:40:53,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a670ade >2013-12-04 10:40:53,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5a670ade >2013-12-04 10:40:53,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5c89d83f >2013-12-04 10:40:53,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a71de59, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@777f6696}, log id: 5c89d83f >2013-12-04 10:40:58,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3e6bfa69 >2013-12-04 10:40:59,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e6bfa69 >2013-12-04 10:40:59,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 78814aa1 >2013-12-04 10:40:59,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7eafaf29, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14ebe360}, log id: 78814aa1 >2013-12-04 10:41:04,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 234e0a21 >2013-12-04 10:41:05,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 234e0a21 >2013-12-04 10:41:05,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2754ea75 >2013-12-04 10:41:05,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@774021a7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e14d46f4}, log id: 2754ea75 >2013-12-04 10:41:10,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42c38e27 >2013-12-04 10:41:11,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 42c38e27 >2013-12-04 10:41:11,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6e12305c >2013-12-04 10:41:11,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a9fa645, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b89d1180}, log id: 6e12305c >2013-12-04 10:41:13,185 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-04 10:41:13,187 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:41:13,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74d1a3f9 >2013-12-04 10:41:13,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 74d1a3f9 >2013-12-04 10:41:16,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2888efd2 >2013-12-04 10:41:16,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2888efd2 >2013-12-04 10:41:16,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 72833107 >2013-12-04 10:41:17,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e83e2480, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0c8033c}, log id: 72833107 >2013-12-04 10:41:22,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 359f8cd4 >2013-12-04 10:41:22,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 359f8cd4 >2013-12-04 10:41:22,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f45cdac >2013-12-04 10:41:23,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57f8edf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f8288c5}, log id: 3f45cdac >2013-12-04 10:41:28,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 670e35bd >2013-12-04 10:41:28,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 670e35bd >2013-12-04 10:41:28,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 198785b5 >2013-12-04 10:41:28,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e07b02ff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@184a1588}, log id: 198785b5 >2013-12-04 10:41:33,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: e916b2d >2013-12-04 10:41:34,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: e916b2d >2013-12-04 10:41:34,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4b7ca548 >2013-12-04 10:41:34,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@883444ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@954300}, log id: 4b7ca548 >2013-12-04 10:41:39,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4abedf33 >2013-12-04 10:41:40,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4abedf33 >2013-12-04 10:41:40,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e3ac418 >2013-12-04 10:41:40,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16d05e6b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f92b396}, log id: 1e3ac418 >2013-12-04 10:41:45,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5bf9be6a >2013-12-04 10:41:46,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5bf9be6a >2013-12-04 10:41:46,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5ea06ba7 >2013-12-04 10:41:46,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6375ab91, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa22cc7f}, log id: 5ea06ba7 >2013-12-04 10:41:51,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3fa12289 >2013-12-04 10:41:51,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3fa12289 >2013-12-04 10:41:51,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47f73352 >2013-12-04 10:41:52,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75d3e984, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cd2a2b2}, log id: 47f73352 >2013-12-04 10:41:57,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 143b4470 >2013-12-04 10:41:57,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 143b4470 >2013-12-04 10:41:57,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 46a425f4 >2013-12-04 10:41:57,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92bdc1c3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c104b756}, log id: 46a425f4 >2013-12-04 10:42:03,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 742f9c30 >2013-12-04 10:42:03,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 742f9c30 >2013-12-04 10:42:03,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6adcb697 >2013-12-04 10:42:03,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c84fd5e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7de742e}, log id: 6adcb697 >2013-12-04 10:42:08,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41d3f41 >2013-12-04 10:42:09,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 41d3f41 >2013-12-04 10:42:09,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 533449c5 >2013-12-04 10:42:09,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce3026d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8d77397}, log id: 533449c5 >2013-12-04 10:42:13,500 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-04 10:42:13,530 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:42:13,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 304b0b4e >2013-12-04 10:42:13,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: 304b0b4e >2013-12-04 10:42:14,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 16e685a4 >2013-12-04 10:42:15,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 16e685a4 >2013-12-04 10:42:15,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2f1553f8 >2013-12-04 10:42:15,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aefa4369, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75aa71f}, log id: 2f1553f8 >2013-12-04 10:42:20,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 62cd6516 >2013-12-04 10:42:20,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 62cd6516 >2013-12-04 10:42:20,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4229c87 >2013-12-04 10:42:21,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c368bad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2dccf9cc}, log id: 4229c87 >2013-12-04 10:42:26,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 58605aa1 >2013-12-04 10:42:26,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 58605aa1 >2013-12-04 10:42:26,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4cabe903 >2013-12-04 10:42:27,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ed0d268, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb39aca4}, log id: 4cabe903 >2013-12-04 10:42:32,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5207dcc6 >2013-12-04 10:42:32,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5207dcc6 >2013-12-04 10:42:32,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: a8a525f >2013-12-04 10:42:32,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@216babdf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2193f93}, log id: a8a525f >2013-12-04 10:42:37,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1acd5de3 >2013-12-04 10:42:38,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1acd5de3 >2013-12-04 10:42:38,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3bf23bc0 >2013-12-04 10:42:38,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a002835, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@777cd661}, log id: 3bf23bc0 >2013-12-04 10:42:43,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 50680af >2013-12-04 10:42:44,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 50680af >2013-12-04 10:42:44,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2333f634 >2013-12-04 10:42:44,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14398c21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd1f2e69}, log id: 2333f634 >2013-12-04 10:42:49,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 213de411 >2013-12-04 10:42:50,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 213de411 >2013-12-04 10:42:50,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19fe8089 >2013-12-04 10:42:50,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a5de479, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1404ba0b}, log id: 19fe8089 >2013-12-04 10:42:55,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32bafa74 >2013-12-04 10:42:55,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 32bafa74 >2013-12-04 10:42:55,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4fbc8843 >2013-12-04 10:42:56,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db315b58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21bbf806}, log id: 4fbc8843 >2013-12-04 10:43:01,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 177e6e0c >2013-12-04 10:43:01,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 177e6e0c >2013-12-04 10:43:01,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2f178c88 >2013-12-04 10:43:01,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be1190c7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ad07fb9}, log id: 2f178c88 >2013-12-04 10:43:06,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 61cc82ca >2013-12-04 10:43:07,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 61cc82ca >2013-12-04 10:43:07,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2d31f74c >2013-12-04 10:43:07,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@950687fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d27cfcf3}, log id: 2d31f74c >2013-12-04 10:43:12,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 45c1a1ec >2013-12-04 10:43:13,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 45c1a1ec >2013-12-04 10:43:13,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 35d55faa >2013-12-04 10:43:13,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a623549, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@935b9e28}, log id: 35d55faa >2013-12-04 10:43:13,837 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-04 10:43:13,837 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:43:13,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1d491251 >2013-12-04 10:43:14,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1d491251 >2013-12-04 10:43:18,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1875aec8 >2013-12-04 10:43:19,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1875aec8 >2013-12-04 10:43:19,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 15c7ff31 >2013-12-04 10:43:19,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@832f37c6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b41d602c}, log id: 15c7ff31 >2013-12-04 10:43:24,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 21481d14 >2013-12-04 10:43:24,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 21481d14 >2013-12-04 10:43:24,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 560637e9 >2013-12-04 10:43:25,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d8fcbc7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a4015b2}, log id: 560637e9 >2013-12-04 10:43:30,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: ce3c8e4 >2013-12-04 10:43:30,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: ce3c8e4 >2013-12-04 10:43:30,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 551e8d78 >2013-12-04 10:43:31,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe95dd6f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c7097cf}, log id: 551e8d78 >2013-12-04 10:43:36,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5ede4316 >2013-12-04 10:43:36,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5ede4316 >2013-12-04 10:43:36,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e7bdbd9 >2013-12-04 10:43:36,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ec84a81, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@542477e4}, log id: 2e7bdbd9 >2013-12-04 10:43:41,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7dd432cf >2013-12-04 10:43:42,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7dd432cf >2013-12-04 10:43:42,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c85e95d >2013-12-04 10:43:42,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5fe0e3b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a87a4d4a}, log id: 1c85e95d >2013-12-04 10:43:47,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 35590fb0 >2013-12-04 10:43:48,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 35590fb0 >2013-12-04 10:43:48,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 12590fde >2013-12-04 10:43:48,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74793b68, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5aadb5ff}, log id: 12590fde >2013-12-04 10:43:53,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 445d135d >2013-12-04 10:43:54,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 445d135d >2013-12-04 10:43:54,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78d64867 >2013-12-04 10:43:54,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47bd4db9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7a73057}, log id: 78d64867 >2013-12-04 10:43:59,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f9f4ff9 >2013-12-04 10:43:59,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3f9f4ff9 >2013-12-04 10:43:59,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7672ece2 >2013-12-04 10:44:00,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f7fa12a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ecf297c9}, log id: 7672ece2 >2013-12-04 10:44:05,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7155d173 >2013-12-04 10:44:05,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7155d173 >2013-12-04 10:44:05,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 15a10784 >2013-12-04 10:44:06,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cb962dc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@331bbe42}, log id: 15a10784 >2013-12-04 10:44:11,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63d19a67 >2013-12-04 10:44:11,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 63d19a67 >2013-12-04 10:44:11,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 68c1737 >2013-12-04 10:44:11,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@571f4340, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@760b279d}, log id: 68c1737 >2013-12-04 10:44:14,137 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [6d2d632b] No up server in cluster >2013-12-04 10:44:14,139 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [6d2d632b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:44:14,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 306917b2 >2013-12-04 10:44:14,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterTasksListVDSCommand, return: [], log id: 306917b2 >2013-12-04 10:44:16,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ed5e173 >2013-12-04 10:44:17,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1ed5e173 >2013-12-04 10:44:17,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7853d574 >2013-12-04 10:44:17,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b70e81f3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2ea0c78}, log id: 7853d574 >2013-12-04 10:44:22,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2b25cfb2 >2013-12-04 10:44:23,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b25cfb2 >2013-12-04 10:44:23,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 668d6314 >2013-12-04 10:44:23,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb82bfbe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4d63722}, log id: 668d6314 >2013-12-04 10:44:28,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 114662c9 >2013-12-04 10:44:29,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 114662c9 >2013-12-04 10:44:29,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c23e0ea >2013-12-04 10:44:29,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e36d80ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a6e7ec7}, log id: 6c23e0ea >2013-12-04 10:44:34,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 69fb8b26 >2013-12-04 10:44:34,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 69fb8b26 >2013-12-04 10:44:34,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7264803 >2013-12-04 10:44:35,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dc34932, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c964a0f3}, log id: 7264803 >2013-12-04 10:44:40,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: f1b6efa >2013-12-04 10:44:40,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: f1b6efa >2013-12-04 10:44:40,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 444dbd2b >2013-12-04 10:44:40,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d59d013, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2670d09b}, log id: 444dbd2b >2013-12-04 10:44:43,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 589b4e6b >2013-12-04 10:44:43,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3c99a356, log id: 589b4e6b >2013-12-04 10:44:43,427 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-60) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:44:43,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: ab2822f >2013-12-04 10:44:43,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1d225728, log id: ab2822f >2013-12-04 10:44:46,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7490521b >2013-12-04 10:44:46,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7490521b >2013-12-04 10:44:46,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3275486f >2013-12-04 10:44:46,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50aa60f7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cd95104}, log id: 3275486f >2013-12-04 10:44:51,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2bad6833 >2013-12-04 10:44:52,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2bad6833 >2013-12-04 10:44:52,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e4af5bf >2013-12-04 10:44:52,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0fe56fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@caa47ec4}, log id: 3e4af5bf >2013-12-04 10:44:57,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 533e92a9 >2013-12-04 10:44:58,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 533e92a9 >2013-12-04 10:44:58,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6a86ed55 >2013-12-04 10:44:58,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4eddfa08, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf803e78}, log id: 6a86ed55 >2013-12-04 10:45:03,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2a83c0c1 >2013-12-04 10:45:03,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a83c0c1 >2013-12-04 10:45:03,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 831ea1b >2013-12-04 10:45:04,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfc8e4a1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e944af9}, log id: 831ea1b >2013-12-04 10:45:09,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 21519dbf >2013-12-04 10:45:09,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 21519dbf >2013-12-04 10:45:09,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2eef5d29 >2013-12-04 10:45:10,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb373764, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@189ad8bc}, log id: 2eef5d29 >2013-12-04 10:45:14,443 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-04 10:45:14,443 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:45:14,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2d38ae16 >2013-12-04 10:45:14,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2d38ae16 >2013-12-04 10:45:15,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 81be2c4 >2013-12-04 10:45:15,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 81be2c4 >2013-12-04 10:45:15,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b103e5b >2013-12-04 10:45:15,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@866229b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d38bbfe8}, log id: b103e5b >2013-12-04 10:45:20,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c172f4b >2013-12-04 10:45:21,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: c172f4b >2013-12-04 10:45:21,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ab2478f >2013-12-04 10:45:21,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7165fc62, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd506728}, log id: ab2478f >2013-12-04 10:45:26,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d8f4b97 >2013-12-04 10:45:27,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3d8f4b97 >2013-12-04 10:45:27,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39723f81 >2013-12-04 10:45:27,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@561a9508, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abee6eb6}, log id: 39723f81 >2013-12-04 10:45:32,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d129c >2013-12-04 10:45:33,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4d129c >2013-12-04 10:45:33,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59a52233 >2013-12-04 10:45:33,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db56c03d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad07d1f6}, log id: 59a52233 >2013-12-04 10:45:38,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 786c5018 >2013-12-04 10:45:38,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 786c5018 >2013-12-04 10:45:38,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4f85527 >2013-12-04 10:45:39,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf033cca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fa4d246}, log id: 4f85527 >2013-12-04 10:45:44,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2a5afb42 >2013-12-04 10:45:44,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2a5afb42 >2013-12-04 10:45:44,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77855f0a >2013-12-04 10:45:44,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14448f2b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99c82cd8}, log id: 77855f0a >2013-12-04 10:45:49,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 790e28c9 >2013-12-04 10:45:50,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 790e28c9 >2013-12-04 10:45:50,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: bc171cd >2013-12-04 10:45:50,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5bc144d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b9c8f4c}, log id: bc171cd >2013-12-04 10:45:55,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5667f0a >2013-12-04 10:45:56,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5667f0a >2013-12-04 10:45:56,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 60ccef92 >2013-12-04 10:45:56,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3621181, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2807319e}, log id: 60ccef92 >2013-12-04 10:46:01,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 78947557 >2013-12-04 10:46:02,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 78947557 >2013-12-04 10:46:02,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f51e19f >2013-12-04 10:46:02,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a88708c2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdf150d1}, log id: 5f51e19f >2013-12-04 10:46:07,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61e3dbd5 >2013-12-04 10:46:07,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 61e3dbd5 >2013-12-04 10:46:07,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d5bef49 >2013-12-04 10:46:08,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66891461, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49b517b0}, log id: d5bef49 >2013-12-04 10:46:13,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b453681 >2013-12-04 10:46:13,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: b453681 >2013-12-04 10:46:13,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2dd30742 >2013-12-04 10:46:14,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c39a06a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a388fb3}, log id: 2dd30742 >2013-12-04 10:46:14,749 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-04 10:46:14,751 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:46:14,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5855cdab >2013-12-04 10:46:15,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5855cdab >2013-12-04 10:46:19,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: fccd59c >2013-12-04 10:46:19,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: fccd59c >2013-12-04 10:46:19,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 72f19d2c >2013-12-04 10:46:19,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b86330af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6eec3ef}, log id: 72f19d2c >2013-12-04 10:46:24,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2bae8681 >2013-12-04 10:46:25,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2bae8681 >2013-12-04 10:46:25,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1fd9f3b8 >2013-12-04 10:46:25,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38f73138, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36ecd66c}, log id: 1fd9f3b8 >2013-12-04 10:46:30,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2723e8d5 >2013-12-04 10:46:31,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2723e8d5 >2013-12-04 10:46:31,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 575e334b >2013-12-04 10:46:31,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66f5e96c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@107144f1}, log id: 575e334b >2013-12-04 10:46:36,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5818c72 >2013-12-04 10:46:37,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5818c72 >2013-12-04 10:46:37,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3728cf0e >2013-12-04 10:46:37,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efe3db9e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a888ad6}, log id: 3728cf0e >2013-12-04 10:46:42,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 146d1ebd >2013-12-04 10:46:42,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 146d1ebd >2013-12-04 10:46:42,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ba35d48 >2013-12-04 10:46:43,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4e21fb6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dce3a6fd}, log id: 4ba35d48 >2013-12-04 10:46:48,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1012783d >2013-12-04 10:46:48,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1012783d >2013-12-04 10:46:48,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4c9eec53 >2013-12-04 10:46:48,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5daf2b69, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1eb1e7da}, log id: 4c9eec53 >2013-12-04 10:46:53,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c756cc >2013-12-04 10:46:54,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: c756cc >2013-12-04 10:46:54,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c242496 >2013-12-04 10:46:54,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@914b13be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b5cbbda}, log id: 6c242496 >2013-12-04 10:46:59,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7273a9ff >2013-12-04 10:47:00,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7273a9ff >2013-12-04 10:47:00,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1026807d >2013-12-04 10:47:00,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35a1d4cc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@145a87f5}, log id: 1026807d >2013-12-04 10:47:05,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6798f742 >2013-12-04 10:47:06,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6798f742 >2013-12-04 10:47:06,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1bc228f0 >2013-12-04 10:47:06,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@964923bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12d4f12e}, log id: 1bc228f0 >2013-12-04 10:47:11,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3914f297 >2013-12-04 10:47:11,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3914f297 >2013-12-04 10:47:11,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4df8d261 >2013-12-04 10:47:12,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b78b5d5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d7016a3}, log id: 4df8d261 >2013-12-04 10:47:15,062 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2013-12-04 10:47:15,108 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:47:15,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a278bac >2013-12-04 10:47:15,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5a278bac >2013-12-04 10:47:17,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 285643af >2013-12-04 10:47:17,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 285643af >2013-12-04 10:47:17,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 338d36ac >2013-12-04 10:47:18,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a39f2995, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44964667}, log id: 338d36ac >2013-12-04 10:47:23,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2004008b >2013-12-04 10:47:23,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2004008b >2013-12-04 10:47:23,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2443aeb3 >2013-12-04 10:47:23,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27b6129d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84296b3a}, log id: 2443aeb3 >2013-12-04 10:47:28,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 169a2cb4 >2013-12-04 10:47:29,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 169a2cb4 >2013-12-04 10:47:29,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32197b61 >2013-12-04 10:47:29,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b257c32, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac6e9614}, log id: 32197b61 >2013-12-04 10:47:34,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 474220df >2013-12-04 10:47:35,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 474220df >2013-12-04 10:47:35,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 252dcc81 >2013-12-04 10:47:35,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d89ee377, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3aa0fca}, log id: 252dcc81 >2013-12-04 10:47:40,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 889b673 >2013-12-04 10:47:41,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 889b673 >2013-12-04 10:47:41,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7af1efe6 >2013-12-04 10:47:41,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58859d32, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cc03360}, log id: 7af1efe6 >2013-12-04 10:47:46,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43068edd >2013-12-04 10:47:46,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 43068edd >2013-12-04 10:47:47,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3cc7bc29 >2013-12-04 10:47:47,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34f7d68b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd737ed3}, log id: 3cc7bc29 >2013-12-04 10:47:52,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 232d5fc2 >2013-12-04 10:47:53,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 232d5fc2 >2013-12-04 10:47:53,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a21389 >2013-12-04 10:47:53,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4067d793, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6171025}, log id: 1a21389 >2013-12-04 10:47:58,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a5345cd >2013-12-04 10:47:59,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a5345cd >2013-12-04 10:47:59,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a1d8b16 >2013-12-04 10:47:59,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb6d8a31, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d310feff}, log id: a1d8b16 >2013-12-04 10:48:04,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69925159 >2013-12-04 10:48:04,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 69925159 >2013-12-04 10:48:04,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1cc4d24e >2013-12-04 10:48:05,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77f2e397, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86bc813d}, log id: 1cc4d24e >2013-12-04 10:48:10,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1fc52a7e >2013-12-04 10:48:10,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fc52a7e >2013-12-04 10:48:10,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2eaf7112 >2013-12-04 10:48:11,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5eab293, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@914987cb}, log id: 2eaf7112 >2013-12-04 10:48:15,419 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) No up server in cluster >2013-12-04 10:48:15,451 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:48:15,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f489e40 >2013-12-04 10:48:15,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f489e40 >2013-12-04 10:48:16,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6de33314 >2013-12-04 10:48:16,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6de33314 >2013-12-04 10:48:16,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1e0e7fff >2013-12-04 10:48:16,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34701ddf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd4afc61}, log id: 1e0e7fff >2013-12-04 10:48:21,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d48b5c8 >2013-12-04 10:48:22,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7d48b5c8 >2013-12-04 10:48:22,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1c2c1584 >2013-12-04 10:48:22,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a20d546b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4755190}, log id: 1c2c1584 >2013-12-04 10:48:27,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 434333e6 >2013-12-04 10:48:28,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 434333e6 >2013-12-04 10:48:28,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 152c87ef >2013-12-04 10:48:28,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21b44e9c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2878348}, log id: 152c87ef >2013-12-04 10:48:33,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11b4e15e >2013-12-04 10:48:34,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 11b4e15e >2013-12-04 10:48:34,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d558591 >2013-12-04 10:48:34,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4405ab8b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3fd4b01}, log id: 3d558591 >2013-12-04 10:48:39,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1601607a >2013-12-04 10:48:39,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1601607a >2013-12-04 10:48:39,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 45898276 >2013-12-04 10:48:40,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fa33174, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f952040}, log id: 45898276 >2013-12-04 10:48:45,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4a6fda75 >2013-12-04 10:48:45,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a6fda75 >2013-12-04 10:48:45,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1cae0084 >2013-12-04 10:48:46,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e44f9fa9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e987b69}, log id: 1cae0084 >2013-12-04 10:48:51,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c80bf5b >2013-12-04 10:48:51,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: c80bf5b >2013-12-04 10:48:51,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7408a22d >2013-12-04 10:48:51,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6f7175a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bad8d578}, log id: 7408a22d >2013-12-04 10:48:56,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 647fc300 >2013-12-04 10:48:57,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 647fc300 >2013-12-04 10:48:57,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7558b0e2 >2013-12-04 10:48:57,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13c915b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d76a8afa}, log id: 7558b0e2 >2013-12-04 10:49:02,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b33143f >2013-12-04 10:49:03,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b33143f >2013-12-04 10:49:03,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1cec2b17 >2013-12-04 10:49:03,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca6762f0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfe761e9}, log id: 1cec2b17 >2013-12-04 10:49:08,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2adbce4d >2013-12-04 10:49:09,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2adbce4d >2013-12-04 10:49:09,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e3a666d >2013-12-04 10:49:09,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bf9ac21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f5e6e70}, log id: 6e3a666d >2013-12-04 10:49:14,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5d227460 >2013-12-04 10:49:14,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d227460 >2013-12-04 10:49:14,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1f83ade5 >2013-12-04 10:49:15,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b77dd6b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b02ff171}, log id: 1f83ade5 >2013-12-04 10:49:15,771 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) No up server in cluster >2013-12-04 10:49:15,775 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:49:15,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ddf1857 >2013-12-04 10:49:16,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, return: [], log id: ddf1857 >2013-12-04 10:49:20,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4509fef6 >2013-12-04 10:49:20,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4509fef6 >2013-12-04 10:49:20,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58f09252 >2013-12-04 10:49:21,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd9c4682, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e0a29c}, log id: 58f09252 >2013-12-04 10:49:26,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 662ba1ea >2013-12-04 10:49:26,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 662ba1ea >2013-12-04 10:49:26,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1df053eb >2013-12-04 10:49:26,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1083af7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6a3b22f}, log id: 1df053eb >2013-12-04 10:49:31,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6c95f983 >2013-12-04 10:49:32,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6c95f983 >2013-12-04 10:49:32,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: c0badde >2013-12-04 10:49:32,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@313d6ba9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bb3dced}, log id: c0badde >2013-12-04 10:49:37,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20930cb3 >2013-12-04 10:49:38,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 20930cb3 >2013-12-04 10:49:38,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 321ebe92 >2013-12-04 10:49:38,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f097cafe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a26a8bc}, log id: 321ebe92 >2013-12-04 10:49:43,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5174490d >2013-12-04 10:49:43,724 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-3) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:49:44,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5174490d >2013-12-04 10:49:44,051 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-50) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:49:44,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d696b10 >2013-12-04 10:49:44,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@41527276, log id: 2d696b10 >2013-12-04 10:49:44,338 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-3) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:49:44,347 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-50) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:49:44,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c481004 >2013-12-04 10:49:44,399 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-50) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:49:44,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@64fc548b, log id: 5c481004 >2013-12-04 10:49:44,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7212a578 >2013-12-04 10:49:44,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbeaefe5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91c401b}, log id: 7212a578 >2013-12-04 10:49:49,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c3abd1f >2013-12-04 10:49:50,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1c3abd1f >2013-12-04 10:49:50,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 464d4627 >2013-12-04 10:49:50,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@594c1a84, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bd208ad}, log id: 464d4627 >2013-12-04 10:49:55,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3e57e577 >2013-12-04 10:49:56,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3e57e577 >2013-12-04 10:49:56,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4cac9630 >2013-12-04 10:49:56,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53c5f222, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb6ed3a8}, log id: 4cac9630 >2013-12-04 10:50:01,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69632a29 >2013-12-04 10:50:02,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 69632a29 >2013-12-04 10:50:02,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28a4d97 >2013-12-04 10:50:02,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@474469bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cef65839}, log id: 28a4d97 >2013-12-04 10:50:07,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 56d46e87 >2013-12-04 10:50:07,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 56d46e87 >2013-12-04 10:50:07,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28f71c37 >2013-12-04 10:50:08,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16de07c4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a972b4c}, log id: 28f71c37 >2013-12-04 10:50:13,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1128a2a2 >2013-12-04 10:50:13,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1128a2a2 >2013-12-04 10:50:13,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2edce763 >2013-12-04 10:50:14,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67492b20, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@686febb3}, log id: 2edce763 >2013-12-04 10:50:16,096 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-04 10:50:16,096 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:50:16,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e26cff1 >2013-12-04 10:50:16,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3e26cff1 >2013-12-04 10:50:19,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4afe0870 >2013-12-04 10:50:19,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4afe0870 >2013-12-04 10:50:19,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5488718c >2013-12-04 10:50:19,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fbc4384, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33de8d70}, log id: 5488718c >2013-12-04 10:50:24,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6635d7e2 >2013-12-04 10:50:25,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6635d7e2 >2013-12-04 10:50:25,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f50e7d8 >2013-12-04 10:50:25,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14a5a976, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff8b2627}, log id: 1f50e7d8 >2013-12-04 10:50:30,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 529cf5a >2013-12-04 10:50:31,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 529cf5a >2013-12-04 10:50:31,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14f3ccdd >2013-12-04 10:50:31,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@149241f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8405dabd}, log id: 14f3ccdd >2013-12-04 10:50:36,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 69cbfcde >2013-12-04 10:50:37,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 69cbfcde >2013-12-04 10:50:37,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1c40a18e >2013-12-04 10:50:37,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bed9969, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@251b84d6}, log id: 1c40a18e >2013-12-04 10:50:42,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 79799b8a >2013-12-04 10:50:42,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 79799b8a >2013-12-04 10:50:42,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1625d748 >2013-12-04 10:50:43,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c10c977f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa1bff96}, log id: 1625d748 >2013-12-04 10:50:48,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 685cc03d >2013-12-04 10:50:48,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 685cc03d >2013-12-04 10:50:48,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 205c1f0c >2013-12-04 10:50:48,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6f3e498, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33e6fcc3}, log id: 205c1f0c >2013-12-04 10:50:53,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1909b5ef >2013-12-04 10:50:54,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1909b5ef >2013-12-04 10:50:54,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 48259d76 >2013-12-04 10:50:54,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1a5e083, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcbd3e5a}, log id: 48259d76 >2013-12-04 10:50:59,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 238e3104 >2013-12-04 10:51:00,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 238e3104 >2013-12-04 10:51:00,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a7a95ac >2013-12-04 10:51:00,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8e114dc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f53e8b6}, log id: 6a7a95ac >2013-12-04 10:51:05,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 46296258 >2013-12-04 10:51:06,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 46296258 >2013-12-04 10:51:06,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b743384 >2013-12-04 10:51:06,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3987d42a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7a53534}, log id: b743384 >2013-12-04 10:51:11,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4067c280 >2013-12-04 10:51:11,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4067c280 >2013-12-04 10:51:11,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 66c9bf11 >2013-12-04 10:51:12,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dec59333, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20484ea3}, log id: 66c9bf11 >2013-12-04 10:51:16,408 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) No up server in cluster >2013-12-04 10:51:16,450 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:51:16,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: b635d38 >2013-12-04 10:51:16,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, return: [], log id: b635d38 >2013-12-04 10:51:17,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e2cb70b >2013-12-04 10:51:17,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e2cb70b >2013-12-04 10:51:17,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4ff60e1 >2013-12-04 10:51:18,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6749f085, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@503a2c3e}, log id: 4ff60e1 >2013-12-04 10:51:23,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a181d43 >2013-12-04 10:51:23,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4a181d43 >2013-12-04 10:51:23,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19e56932 >2013-12-04 10:51:23,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbf0d97c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@988ac3ee}, log id: 19e56932 >2013-12-04 10:51:28,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ab02ef5 >2013-12-04 10:51:29,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2ab02ef5 >2013-12-04 10:51:29,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 13f73691 >2013-12-04 10:51:29,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50c0c1ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e57d638}, log id: 13f73691 >2013-12-04 10:51:34,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2108a8e7 >2013-12-04 10:51:35,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2108a8e7 >2013-12-04 10:51:35,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3fe64a58 >2013-12-04 10:51:35,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57dcadc9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b449404d}, log id: 3fe64a58 >2013-12-04 10:51:40,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4785f94e >2013-12-04 10:51:41,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4785f94e >2013-12-04 10:51:41,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 463c7e4a >2013-12-04 10:51:41,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fabc72b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adffedc0}, log id: 463c7e4a >2013-12-04 10:51:46,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38ebfe57 >2013-12-04 10:51:46,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 38ebfe57 >2013-12-04 10:51:47,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2a575259 >2013-12-04 10:51:47,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b66e41ce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24dd110d}, log id: 2a575259 >2013-12-04 10:51:52,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 44093ea4 >2013-12-04 10:51:52,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 44093ea4 >2013-12-04 10:51:52,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1522607a >2013-12-04 10:51:53,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3955bb49, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0fdaf}, log id: 1522607a >2013-12-04 10:51:58,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4bcb1ee5 >2013-12-04 10:51:59,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4bcb1ee5 >2013-12-04 10:51:59,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4487280d >2013-12-04 10:51:59,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78b63a02, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b60a449c}, log id: 4487280d >2013-12-04 10:52:04,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: efc7522 >2013-12-04 10:52:05,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: efc7522 >2013-12-04 10:52:05,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6ee8e086 >2013-12-04 10:52:05,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86f2e3d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d17d0e25}, log id: 6ee8e086 >2013-12-04 10:52:10,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a11b9fb >2013-12-04 10:52:11,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a11b9fb >2013-12-04 10:52:11,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4907c5ab >2013-12-04 10:52:11,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1629d840, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@806e6f54}, log id: 4907c5ab >2013-12-04 10:52:16,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 69dfa51f >2013-12-04 10:52:16,750 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) No up server in cluster >2013-12-04 10:52:16,751 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:52:16,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 726e5219 >2013-12-04 10:52:16,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 69dfa51f >2013-12-04 10:52:16,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 58a5cec2 >2013-12-04 10:52:17,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, return: [], log id: 726e5219 >2013-12-04 10:52:17,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b1129cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@146a7e3d}, log id: 58a5cec2 >2013-12-04 10:52:22,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3b93ba14 >2013-12-04 10:52:22,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b93ba14 >2013-12-04 10:52:22,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2cd05bb1 >2013-12-04 10:52:23,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7daa4ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80970854}, log id: 2cd05bb1 >2013-12-04 10:52:28,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6816640f >2013-12-04 10:52:28,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6816640f >2013-12-04 10:52:28,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 44be09cd >2013-12-04 10:52:28,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8354e3c7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@507ff55d}, log id: 44be09cd >2013-12-04 10:52:33,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5e132861 >2013-12-04 10:52:34,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5e132861 >2013-12-04 10:52:34,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79fc328a >2013-12-04 10:52:34,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6da1d044, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95011a9e}, log id: 79fc328a >2013-12-04 10:52:39,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77bbfd7 >2013-12-04 10:52:40,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 77bbfd7 >2013-12-04 10:52:40,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3e5b8041 >2013-12-04 10:52:40,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9f53656, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8048c42}, log id: 3e5b8041 >2013-12-04 10:52:45,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24dd983a >2013-12-04 10:52:46,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 24dd983a >2013-12-04 10:52:46,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 761ba061 >2013-12-04 10:52:46,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d8d67ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@595591bc}, log id: 761ba061 >2013-12-04 10:52:51,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 345ec39a >2013-12-04 10:52:51,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 345ec39a >2013-12-04 10:52:51,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56c6cdd8 >2013-12-04 10:52:52,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@293b732, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbcaf710}, log id: 56c6cdd8 >2013-12-04 10:52:57,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1921aa93 >2013-12-04 10:52:57,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1921aa93 >2013-12-04 10:52:57,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 361701b5 >2013-12-04 10:52:58,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3299187a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5d98858}, log id: 361701b5 >2013-12-04 10:53:03,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4c388ee3 >2013-12-04 10:53:03,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4c388ee3 >2013-12-04 10:53:03,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c538ca >2013-12-04 10:53:03,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4413502d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2457515}, log id: c538ca >2013-12-04 10:53:08,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 767119d6 >2013-12-04 10:53:09,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 767119d6 >2013-12-04 10:53:09,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1fb69b48 >2013-12-04 10:53:09,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95bf500b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c70d030}, log id: 1fb69b48 >2013-12-04 10:53:14,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9f905c >2013-12-04 10:53:15,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 9f905c >2013-12-04 10:53:15,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d806acc >2013-12-04 10:53:15,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7119786c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@211a4abe}, log id: 4d806acc >2013-12-04 10:53:17,039 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) No up server in cluster >2013-12-04 10:53:17,043 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:53:17,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5041e22a >2013-12-04 10:53:17,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5041e22a >2013-12-04 10:53:20,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20d6fbae >2013-12-04 10:53:20,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 20d6fbae >2013-12-04 10:53:20,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 113d1b2a >2013-12-04 10:53:21,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de2dbd9a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7396d29f}, log id: 113d1b2a >2013-12-04 10:53:26,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a317f6 >2013-12-04 10:53:26,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4a317f6 >2013-12-04 10:53:26,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7fa2cca >2013-12-04 10:53:27,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70aeafbd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9906a51}, log id: 7fa2cca >2013-12-04 10:53:32,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2e10d8d5 >2013-12-04 10:53:32,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e10d8d5 >2013-12-04 10:53:32,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3cbdab35 >2013-12-04 10:53:32,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c95a6a2a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4808f1f}, log id: 3cbdab35 >2013-12-04 10:53:37,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a5cacfc >2013-12-04 10:53:38,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6a5cacfc >2013-12-04 10:53:38,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 689a28ed >2013-12-04 10:53:38,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0a51e32, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4ce387a}, log id: 689a28ed >2013-12-04 10:53:43,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7563e2cd >2013-12-04 10:53:44,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7563e2cd >2013-12-04 10:53:44,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17be18cf >2013-12-04 10:53:44,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f21719, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47103dd3}, log id: 17be18cf >2013-12-04 10:53:49,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5919fff7 >2013-12-04 10:53:50,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5919fff7 >2013-12-04 10:53:50,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 55bcacd3 >2013-12-04 10:53:50,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3417bb1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5de5dcd6}, log id: 55bcacd3 >2013-12-04 10:53:55,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32b0f034 >2013-12-04 10:53:55,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 32b0f034 >2013-12-04 10:53:55,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71ac05f2 >2013-12-04 10:53:56,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2394eaad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd4607e8}, log id: 71ac05f2 >2013-12-04 10:54:01,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 26e6c8ed >2013-12-04 10:54:01,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 26e6c8ed >2013-12-04 10:54:01,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 435ca75e >2013-12-04 10:54:02,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@111a4ce9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1b74406}, log id: 435ca75e >2013-12-04 10:54:07,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: c4f881a >2013-12-04 10:54:07,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: c4f881a >2013-12-04 10:54:07,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 52462a5b >2013-12-04 10:54:07,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe22854a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7bda8fe}, log id: 52462a5b >2013-12-04 10:54:12,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53606e61 >2013-12-04 10:54:13,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 53606e61 >2013-12-04 10:54:13,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b1ad0fb >2013-12-04 10:54:13,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bfb74ba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56db6a37}, log id: 6b1ad0fb >2013-12-04 10:54:17,348 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-04 10:54:17,351 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:54:17,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 53c15876 >2013-12-04 10:54:17,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 53c15876 >2013-12-04 10:54:18,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 55f2189e >2013-12-04 10:54:19,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 55f2189e >2013-12-04 10:54:19,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 44b09a69 >2013-12-04 10:54:19,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ceee4368, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@101ddbd0}, log id: 44b09a69 >2013-12-04 10:54:24,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 63917b5d >2013-12-04 10:54:25,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 63917b5d >2013-12-04 10:54:25,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46a50a5f >2013-12-04 10:54:25,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@136cf421, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@641bf270}, log id: 46a50a5f >2013-12-04 10:54:30,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 251706a8 >2013-12-04 10:54:30,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 251706a8 >2013-12-04 10:54:30,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4d6d51a9 >2013-12-04 10:54:31,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4be8518, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f45c4f34}, log id: 4d6d51a9 >2013-12-04 10:54:36,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c898b6e >2013-12-04 10:54:36,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3c898b6e >2013-12-04 10:54:36,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 702e07ef >2013-12-04 10:54:37,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc515876, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c5ea68c}, log id: 702e07ef >2013-12-04 10:54:42,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3dc4f5b3 >2013-12-04 10:54:42,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3dc4f5b3 >2013-12-04 10:54:42,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 541ba2fa >2013-12-04 10:54:42,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@103a7970, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3f490c0}, log id: 541ba2fa >2013-12-04 10:54:44,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 22f5969 >2013-12-04 10:54:44,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@77387713, log id: 22f5969 >2013-12-04 10:54:44,951 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-26) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:54:44,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1c11bd8b >2013-12-04 10:54:45,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6a76ff25, log id: 1c11bd8b >2013-12-04 10:54:47,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 749b8fa6 >2013-12-04 10:54:48,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 749b8fa6 >2013-12-04 10:54:48,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 37a8b945 >2013-12-04 10:54:48,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7bf5f2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@808d8861}, log id: 37a8b945 >2013-12-04 10:54:53,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 397ef0f7 >2013-12-04 10:54:54,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 397ef0f7 >2013-12-04 10:54:54,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 770a3360 >2013-12-04 10:54:54,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@597bf16c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0e3fb32}, log id: 770a3360 >2013-12-04 10:54:59,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 159aff0d >2013-12-04 10:55:00,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 159aff0d >2013-12-04 10:55:00,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 288db510 >2013-12-04 10:55:00,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@998a3716, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f8e3ca9}, log id: 288db510 >2013-12-04 10:55:05,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 10f3ebd1 >2013-12-04 10:55:05,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 10f3ebd1 >2013-12-04 10:55:05,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 210ba35a >2013-12-04 10:55:06,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@774ad603, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c1aeff7}, log id: 210ba35a >2013-12-04 10:55:11,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 30d39c71 >2013-12-04 10:55:11,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 30d39c71 >2013-12-04 10:55:11,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6d05525c >2013-12-04 10:55:11,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95d8ccad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c17fd40}, log id: 6d05525c >2013-12-04 10:55:16,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 74af84fd >2013-12-04 10:55:17,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 74af84fd >2013-12-04 10:55:17,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: aa675e4 >2013-12-04 10:55:17,646 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-04 10:55:17,646 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:55:17,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a5c61b6 >2013-12-04 10:55:17,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10da5914, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7555907}, log id: aa675e4 >2013-12-04 10:55:17,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1a5c61b6 >2013-12-04 10:55:22,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2063a12 >2013-12-04 10:55:23,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2063a12 >2013-12-04 10:55:23,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d29085e >2013-12-04 10:55:23,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c0c33f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff7c5ad9}, log id: 2d29085e >2013-12-04 10:55:28,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 97fb9b7 >2013-12-04 10:55:29,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 97fb9b7 >2013-12-04 10:55:29,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e113ca6 >2013-12-04 10:55:29,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3bc8a71, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b8cd6ce}, log id: 2e113ca6 >2013-12-04 10:55:34,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3152fe71 >2013-12-04 10:55:34,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3152fe71 >2013-12-04 10:55:34,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20c4c70c >2013-12-04 10:55:35,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63738778, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3ac4a1d}, log id: 20c4c70c >2013-12-04 10:55:40,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5b1936f6 >2013-12-04 10:55:40,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b1936f6 >2013-12-04 10:55:40,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 35349dcb >2013-12-04 10:55:40,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fce3b847, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ffeecf6}, log id: 35349dcb >2013-12-04 10:55:46,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41a6e2a7 >2013-12-04 10:55:46,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 41a6e2a7 >2013-12-04 10:55:46,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b6832fc >2013-12-04 10:55:46,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34c99121, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b3d696f}, log id: 5b6832fc >2013-12-04 10:55:51,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43ba2bba >2013-12-04 10:55:52,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 43ba2bba >2013-12-04 10:55:52,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 65414f18 >2013-12-04 10:55:52,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1a778f2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@721a1dce}, log id: 65414f18 >2013-12-04 10:55:57,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1085a142 >2013-12-04 10:55:58,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1085a142 >2013-12-04 10:55:58,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 55cfe596 >2013-12-04 10:55:58,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1d55c2d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d27599a7}, log id: 55cfe596 >2013-12-04 10:56:03,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 172427b4 >2013-12-04 10:56:04,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 172427b4 >2013-12-04 10:56:04,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e81b1f8 >2013-12-04 10:56:04,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1aab40e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d0e39e6}, log id: 4e81b1f8 >2013-12-04 10:56:09,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e7f42c9 >2013-12-04 10:56:10,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4e7f42c9 >2013-12-04 10:56:10,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 648a7146 >2013-12-04 10:56:10,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2573924c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@817158ef}, log id: 648a7146 >2013-12-04 10:56:15,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 192e38aa >2013-12-04 10:56:15,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 192e38aa >2013-12-04 10:56:15,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3c72a405 >2013-12-04 10:56:16,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e44a7272, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97f6f592}, log id: 3c72a405 >2013-12-04 10:56:17,954 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-04 10:56:17,955 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:56:17,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e758d0d >2013-12-04 10:56:18,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5e758d0d >2013-12-04 10:56:21,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d9a2b6d >2013-12-04 10:56:21,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2d9a2b6d >2013-12-04 10:56:21,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 16e84867 >2013-12-04 10:56:22,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9921940b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0ebc822}, log id: 16e84867 >2013-12-04 10:56:27,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6202551f >2013-12-04 10:56:27,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6202551f >2013-12-04 10:56:27,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 8c8dd3a >2013-12-04 10:56:27,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4f72d13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5bebf8e}, log id: 8c8dd3a >2013-12-04 10:56:32,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a34111a >2013-12-04 10:56:33,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6a34111a >2013-12-04 10:56:33,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b53946f >2013-12-04 10:56:33,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b87380e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb7124b}, log id: b53946f >2013-12-04 10:56:38,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7305b9a >2013-12-04 10:56:39,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7305b9a >2013-12-04 10:56:39,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5dbf1a8d >2013-12-04 10:56:39,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e11339b6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc05bdcd}, log id: 5dbf1a8d >2013-12-04 10:56:44,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b09f0cd >2013-12-04 10:56:45,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2b09f0cd >2013-12-04 10:56:45,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7c2cf689 >2013-12-04 10:56:45,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbbe4257, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a64aad49}, log id: 7c2cf689 >2013-12-04 10:56:50,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 739a1d7 >2013-12-04 10:56:50,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 739a1d7 >2013-12-04 10:56:50,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41ea7aee >2013-12-04 10:56:51,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9987cd49, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbe7a82c}, log id: 41ea7aee >2013-12-04 10:56:56,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 433bacc2 >2013-12-04 10:56:56,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 433bacc2 >2013-12-04 10:56:56,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 13263b3b >2013-12-04 10:56:57,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@595c2066, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9767c7b}, log id: 13263b3b >2013-12-04 10:57:02,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 143538bd >2013-12-04 10:57:02,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 143538bd >2013-12-04 10:57:02,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30d44d2e >2013-12-04 10:57:02,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aae964ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da39597}, log id: 30d44d2e >2013-12-04 10:57:07,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 65787c6a >2013-12-04 10:57:08,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 65787c6a >2013-12-04 10:57:08,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 27b0e1c8 >2013-12-04 10:57:08,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbd00f1c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b1c6118}, log id: 27b0e1c8 >2013-12-04 10:57:13,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2d24bfd9 >2013-12-04 10:57:14,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2d24bfd9 >2013-12-04 10:57:14,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 573190fd >2013-12-04 10:57:14,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50302767, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d80fed90}, log id: 573190fd >2013-12-04 10:57:18,267 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] No up server in cluster >2013-12-04 10:57:18,314 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:57:18,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 57e24a49 >2013-12-04 10:57:18,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterTasksListVDSCommand, return: [], log id: 57e24a49 >2013-12-04 10:57:19,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: c43db8 >2013-12-04 10:57:20,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: c43db8 >2013-12-04 10:57:20,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 321ad660 >2013-12-04 10:57:20,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54a21614, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9bfe82b}, log id: 321ad660 >2013-12-04 10:57:25,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 76e123f1 >2013-12-04 10:57:25,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 76e123f1 >2013-12-04 10:57:25,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 116a81f1 >2013-12-04 10:57:26,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60035756, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baadbcb}, log id: 116a81f1 >2013-12-04 10:57:31,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f02ccd1 >2013-12-04 10:57:31,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3f02ccd1 >2013-12-04 10:57:31,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1cd91410 >2013-12-04 10:57:31,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a0497d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b379dabe}, log id: 1cd91410 >2013-12-04 10:57:36,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5885245e >2013-12-04 10:57:37,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5885245e >2013-12-04 10:57:37,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 251d7588 >2013-12-04 10:57:37,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af68d7eb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d74dae15}, log id: 251d7588 >2013-12-04 10:57:42,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 403761c4 >2013-12-04 10:57:43,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 403761c4 >2013-12-04 10:57:43,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7277b48d >2013-12-04 10:57:43,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ae727a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a70a99e1}, log id: 7277b48d >2013-12-04 10:57:48,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d78b1ee >2013-12-04 10:57:49,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: d78b1ee >2013-12-04 10:57:49,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6430914e >2013-12-04 10:57:49,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@daac45be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb18b180}, log id: 6430914e >2013-12-04 10:57:54,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10385fdb >2013-12-04 10:57:54,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 10385fdb >2013-12-04 10:57:54,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 22c33cbe >2013-12-04 10:57:55,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a298ec40, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@232bce9b}, log id: 22c33cbe >2013-12-04 10:58:00,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55252786 >2013-12-04 10:58:00,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 55252786 >2013-12-04 10:58:00,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c87746a >2013-12-04 10:58:01,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa8c41d1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73e83619}, log id: 6c87746a >2013-12-04 10:58:06,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2c476efe >2013-12-04 10:58:06,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c476efe >2013-12-04 10:58:06,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 59cf6de9 >2013-12-04 10:58:06,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@488199c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44d9d41d}, log id: 59cf6de9 >2013-12-04 10:58:11,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e59e7ce >2013-12-04 10:58:12,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4e59e7ce >2013-12-04 10:58:12,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3bf68b57 >2013-12-04 10:58:12,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53b0d1f0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0ec4250}, log id: 3bf68b57 >2013-12-04 10:58:17,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5c67eee8 >2013-12-04 10:58:18,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c67eee8 >2013-12-04 10:58:18,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 39ccc916 >2013-12-04 10:58:18,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32a1be56, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2c6a2d4}, log id: 39ccc916 >2013-12-04 10:58:18,651 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) No up server in cluster >2013-12-04 10:58:18,674 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:58:18,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 9a4f478 >2013-12-04 10:58:18,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, return: [], log id: 9a4f478 >2013-12-04 10:58:23,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 8acf017 >2013-12-04 10:58:24,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 8acf017 >2013-12-04 10:58:24,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a945d2 >2013-12-04 10:58:24,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b52915, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f645ce57}, log id: 6a945d2 >2013-12-04 10:58:29,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3ae61b15 >2013-12-04 10:58:29,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3ae61b15 >2013-12-04 10:58:29,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3243c535 >2013-12-04 10:58:30,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0160065, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0c94459}, log id: 3243c535 >2013-12-04 10:58:35,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70feded8 >2013-12-04 10:58:35,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 70feded8 >2013-12-04 10:58:35,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 27dc67bb >2013-12-04 10:58:35,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22d36659, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27f05e47}, log id: 27dc67bb >2013-12-04 10:58:40,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 22a9457b >2013-12-04 10:58:41,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 22a9457b >2013-12-04 10:58:41,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 286a474d >2013-12-04 10:58:41,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@693738b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38009a92}, log id: 286a474d >2013-12-04 10:58:46,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ff0374d >2013-12-04 10:58:47,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5ff0374d >2013-12-04 10:58:47,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 15b6c32c >2013-12-04 10:58:47,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45ae0760, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af2d903}, log id: 15b6c32c >2013-12-04 10:58:52,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f37094f >2013-12-04 10:58:53,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3f37094f >2013-12-04 10:58:53,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4409a93a >2013-12-04 10:58:53,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa6d1541, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a51e82c5}, log id: 4409a93a >2013-12-04 10:58:58,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 65438451 >2013-12-04 10:58:58,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 65438451 >2013-12-04 10:58:58,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6e954cc2 >2013-12-04 10:58:59,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2fa2308, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74640eb2}, log id: 6e954cc2 >2013-12-04 10:59:04,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 464894b5 >2013-12-04 10:59:04,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 464894b5 >2013-12-04 10:59:04,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47cf6f61 >2013-12-04 10:59:04,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ea74635, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e3a2963}, log id: 47cf6f61 >2013-12-04 10:59:10,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6bb93ed7 >2013-12-04 10:59:10,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6bb93ed7 >2013-12-04 10:59:10,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50f081a2 >2013-12-04 10:59:10,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8621fb04, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@feb18724}, log id: 50f081a2 >2013-12-04 10:59:15,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34b39f2c >2013-12-04 10:59:16,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 34b39f2c >2013-12-04 10:59:16,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6d67dd80 >2013-12-04 10:59:16,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b784bf79, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31a48a9}, log id: 6d67dd80 >2013-12-04 10:59:18,972 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) No up server in cluster >2013-12-04 10:59:18,991 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:59:18,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7953701 >2013-12-04 10:59:19,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7953701 >2013-12-04 10:59:21,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35c155f8 >2013-12-04 10:59:22,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 35c155f8 >2013-12-04 10:59:22,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4556dac4 >2013-12-04 10:59:22,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26ec3c69, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4335a20}, log id: 4556dac4 >2013-12-04 10:59:27,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 751bbbf >2013-12-04 10:59:27,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 751bbbf >2013-12-04 10:59:27,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7026f33d >2013-12-04 10:59:28,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5da7a216, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2decb3f}, log id: 7026f33d >2013-12-04 10:59:33,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3b3b3baa >2013-12-04 10:59:33,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b3b3baa >2013-12-04 10:59:33,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2e6c01ac >2013-12-04 10:59:34,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35b51cf3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9e1d203}, log id: 2e6c01ac >2013-12-04 10:59:39,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b62679d >2013-12-04 10:59:39,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7b62679d >2013-12-04 10:59:39,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 424bd727 >2013-12-04 10:59:39,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d0deaa6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73bc7c65}, log id: 424bd727 >2013-12-04 10:59:44,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5ac0add0 >2013-12-04 10:59:45,247 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-88) [6463bdcc] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:59:45,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5ac0add0 >2013-12-04 10:59:45,453 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-88) [6463bdcc] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 10:59:45,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5fa10262 >2013-12-04 10:59:45,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc47d904, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64dc5ea0}, log id: 5fa10262 >2013-12-04 10:59:45,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12cd12df >2013-12-04 10:59:46,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7543dba, log id: 12cd12df >2013-12-04 10:59:46,011 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-88) [6463bdcc] Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 10:59:46,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ba08218 >2013-12-04 10:59:46,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@286aebc6, log id: 2ba08218 >2013-12-04 10:59:50,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5b129c07 >2013-12-04 10:59:51,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b129c07 >2013-12-04 10:59:51,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 679f12f4 >2013-12-04 10:59:51,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99606df8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5a62426}, log id: 679f12f4 >2013-12-04 10:59:56,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3bf352ad >2013-12-04 10:59:57,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bf352ad >2013-12-04 10:59:57,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 16494b35 >2013-12-04 10:59:57,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8aa88a7e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51445181}, log id: 16494b35 >2013-12-04 11:00:02,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41e998ef >2013-12-04 11:00:02,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 41e998ef >2013-12-04 11:00:02,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e3c33e3 >2013-12-04 11:00:03,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3319626, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95258481}, log id: e3c33e3 >2013-12-04 11:00:08,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36da7906 >2013-12-04 11:00:08,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 36da7906 >2013-12-04 11:00:08,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 62d3ce5a >2013-12-04 11:00:09,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31a2ce81, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@319258b9}, log id: 62d3ce5a >2013-12-04 11:00:14,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 31cb96b3 >2013-12-04 11:00:14,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 31cb96b3 >2013-12-04 11:00:14,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7eb9db88 >2013-12-04 11:00:14,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efd26ace, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4dea2e5}, log id: 7eb9db88 >2013-12-04 11:00:19,282 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-04 11:00:19,284 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:00:19,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: bd7a337 >2013-12-04 11:00:19,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: bd7a337 >2013-12-04 11:00:19,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b7e3b9d >2013-12-04 11:00:20,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6b7e3b9d >2013-12-04 11:00:20,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 160c4a19 >2013-12-04 11:00:20,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43d31fc6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d33d7b5}, log id: 160c4a19 >2013-12-04 11:00:25,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4bcf0190 >2013-12-04 11:00:26,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4bcf0190 >2013-12-04 11:00:26,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7c122e04 >2013-12-04 11:00:26,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af35620b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1020274}, log id: 7c122e04 >2013-12-04 11:00:31,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 29a3892f >2013-12-04 11:00:31,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 29a3892f >2013-12-04 11:00:31,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 30c6ee4d >2013-12-04 11:00:32,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d12f42d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85cf9d5}, log id: 30c6ee4d >2013-12-04 11:00:37,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 134d92a8 >2013-12-04 11:00:37,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 134d92a8 >2013-12-04 11:00:37,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ec05568 >2013-12-04 11:00:38,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@315f9447, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec9fb4fd}, log id: ec05568 >2013-12-04 11:00:43,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 475dd42e >2013-12-04 11:00:43,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 475dd42e >2013-12-04 11:00:43,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d4216ee >2013-12-04 11:00:43,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97585302, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fe93ef6}, log id: d4216ee >2013-12-04 11:00:48,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 748c842a >2013-12-04 11:00:49,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 748c842a >2013-12-04 11:00:49,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4855fc35 >2013-12-04 11:00:49,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e51638dc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d54c76d}, log id: 4855fc35 >2013-12-04 11:00:54,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67a3b86 >2013-12-04 11:00:55,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 67a3b86 >2013-12-04 11:00:55,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3d7c91a2 >2013-12-04 11:00:55,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54649665, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@743cc9da}, log id: 3d7c91a2 >2013-12-04 11:01:00,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 24cb1f12 >2013-12-04 11:01:01,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 24cb1f12 >2013-12-04 11:01:01,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 39d3e917 >2013-12-04 11:01:01,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34c266b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cbe80f6}, log id: 39d3e917 >2013-12-04 11:01:06,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53eb311 >2013-12-04 11:01:06,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 53eb311 >2013-12-04 11:01:06,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5e6e066b >2013-12-04 11:01:07,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@851e61a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a37bb234}, log id: 5e6e066b >2013-12-04 11:01:12,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 516514f8 >2013-12-04 11:01:12,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 516514f8 >2013-12-04 11:01:12,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6f266573 >2013-12-04 11:01:12,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45b00250, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@327caedf}, log id: 6f266573 >2013-12-04 11:01:18,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7927b7f6 >2013-12-04 11:01:18,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7927b7f6 >2013-12-04 11:01:18,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70c77b4a >2013-12-04 11:01:18,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b36a4590, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8d97786}, log id: 70c77b4a >2013-12-04 11:01:19,595 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) No up server in cluster >2013-12-04 11:01:19,670 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:01:19,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 234cd6c2 >2013-12-04 11:01:19,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterTasksListVDSCommand, return: [], log id: 234cd6c2 >2013-12-04 11:01:23,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6d250ed7 >2013-12-04 11:01:24,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6d250ed7 >2013-12-04 11:01:24,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2dbad405 >2013-12-04 11:01:24,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb0e6c0f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@681f8cc1}, log id: 2dbad405 >2013-12-04 11:01:29,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 59b90c3d >2013-12-04 11:01:30,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 59b90c3d >2013-12-04 11:01:30,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1656e21e >2013-12-04 11:01:30,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@619cc2c8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa9db97c}, log id: 1656e21e >2013-12-04 11:01:35,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a34df56 >2013-12-04 11:01:35,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4a34df56 >2013-12-04 11:01:35,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: a72d057 >2013-12-04 11:01:36,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8281f51e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f41e6d6}, log id: a72d057 >2013-12-04 11:01:41,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7d2f7e1c >2013-12-04 11:01:41,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7d2f7e1c >2013-12-04 11:01:41,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3bbd382d >2013-12-04 11:01:42,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99c51ee4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57cbea2a}, log id: 3bbd382d >2013-12-04 11:01:47,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1bfc8c24 >2013-12-04 11:01:47,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1bfc8c24 >2013-12-04 11:01:47,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10ab24c6 >2013-12-04 11:01:47,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7878840, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d46b547}, log id: 10ab24c6 >2013-12-04 11:01:52,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4af2257a >2013-12-04 11:01:53,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4af2257a >2013-12-04 11:01:53,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50f64d2a >2013-12-04 11:01:53,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcd1f58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99e309cc}, log id: 50f64d2a >2013-12-04 11:01:58,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ab6a106 >2013-12-04 11:01:59,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1ab6a106 >2013-12-04 11:01:59,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 98247f7 >2013-12-04 11:01:59,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59616c74, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22466f59}, log id: 98247f7 >2013-12-04 11:02:04,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1fad307 >2013-12-04 11:02:05,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1fad307 >2013-12-04 11:02:05,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6d657030 >2013-12-04 11:02:05,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64d03159, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4b455e0}, log id: 6d657030 >2013-12-04 11:02:10,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2a7794e9 >2013-12-04 11:02:10,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a7794e9 >2013-12-04 11:02:10,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 274654b7 >2013-12-04 11:02:11,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68d12152, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@539ab38e}, log id: 274654b7 >2013-12-04 11:02:16,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 29f08116 >2013-12-04 11:02:16,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 29f08116 >2013-12-04 11:02:16,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 376f4b51 >2013-12-04 11:02:16,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e11862f1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a81db9e}, log id: 376f4b51 >2013-12-04 11:02:19,978 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) No up server in cluster >2013-12-04 11:02:20,008 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:02:20,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7adc81cb >2013-12-04 11:02:20,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7adc81cb >2013-12-04 11:02:22,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 680df189 >2013-12-04 11:02:22,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 680df189 >2013-12-04 11:02:22,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1b063e63 >2013-12-04 11:02:22,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a912e2d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18f31e8e}, log id: 1b063e63 >2013-12-04 11:02:27,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1de75dfd >2013-12-04 11:02:28,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1de75dfd >2013-12-04 11:02:28,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7610abd5 >2013-12-04 11:02:28,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f25bab53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7b93adb}, log id: 7610abd5 >2013-12-04 11:02:33,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 77d57b92 >2013-12-04 11:02:34,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 77d57b92 >2013-12-04 11:02:34,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 136ec890 >2013-12-04 11:02:34,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c28d4f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4cf8545}, log id: 136ec890 >2013-12-04 11:02:39,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48a4975d >2013-12-04 11:02:40,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 48a4975d >2013-12-04 11:02:40,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4a4e2cd9 >2013-12-04 11:02:40,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fb9078d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12c7334d}, log id: 4a4e2cd9 >2013-12-04 11:02:45,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 676addf4 >2013-12-04 11:02:45,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 676addf4 >2013-12-04 11:02:45,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 63d06f58 >2013-12-04 11:02:46,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc272d1b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98ce0092}, log id: 63d06f58 >2013-12-04 11:02:51,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 61c94040 >2013-12-04 11:02:51,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 61c94040 >2013-12-04 11:02:51,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 40736d1d >2013-12-04 11:02:51,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89e5012d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fed5f7a}, log id: 40736d1d >2013-12-04 11:02:56,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d3da3a2 >2013-12-04 11:02:57,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5d3da3a2 >2013-12-04 11:02:57,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d5cdd86 >2013-12-04 11:02:57,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52d96372, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a48e4e2}, log id: 6d5cdd86 >2013-12-04 11:03:02,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4293469c >2013-12-04 11:03:03,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4293469c >2013-12-04 11:03:03,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3c02a989 >2013-12-04 11:03:03,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5295b68b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25481a4d}, log id: 3c02a989 >2013-12-04 11:03:08,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 52fbd530 >2013-12-04 11:03:09,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 52fbd530 >2013-12-04 11:03:09,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6249a057 >2013-12-04 11:03:09,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ceaaef6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c415fd30}, log id: 6249a057 >2013-12-04 11:03:14,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f8ea769 >2013-12-04 11:03:14,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f8ea769 >2013-12-04 11:03:14,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c21e165 >2013-12-04 11:03:15,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f357bbc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2624dbc}, log id: 5c21e165 >2013-12-04 11:03:20,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11ddbff4 >2013-12-04 11:03:20,327 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-38) No up server in cluster >2013-12-04 11:03:20,327 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-38) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:03:20,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 44875132 >2013-12-04 11:03:20,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterTasksListVDSCommand, return: [], log id: 44875132 >2013-12-04 11:03:20,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 11ddbff4 >2013-12-04 11:03:20,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: cd008d >2013-12-04 11:03:21,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2a5f60f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1194f90}, log id: cd008d >2013-12-04 11:03:26,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2cbc5c4 >2013-12-04 11:03:26,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2cbc5c4 >2013-12-04 11:03:26,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ed7cc85 >2013-12-04 11:03:26,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2dae8f1a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8eeac45}, log id: 6ed7cc85 >2013-12-04 11:03:31,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e48ef92 >2013-12-04 11:03:32,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1e48ef92 >2013-12-04 11:03:32,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 208868e9 >2013-12-04 11:03:32,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f903840a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6940f1}, log id: 208868e9 >2013-12-04 11:03:37,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53d440 >2013-12-04 11:03:38,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 53d440 >2013-12-04 11:03:38,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c0294c8 >2013-12-04 11:03:38,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91365748, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55926762}, log id: 4c0294c8 >2013-12-04 11:03:43,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2620b535 >2013-12-04 11:03:44,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2620b535 >2013-12-04 11:03:44,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1fe7f962 >2013-12-04 11:03:44,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d361e5c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7215c86}, log id: 1fe7f962 >2013-12-04 11:03:49,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 43441dd5 >2013-12-04 11:03:49,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 43441dd5 >2013-12-04 11:03:49,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70b52f09 >2013-12-04 11:03:50,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@585cf168, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2afa287}, log id: 70b52f09 >2013-12-04 11:03:55,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 17a54e0a >2013-12-04 11:03:55,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 17a54e0a >2013-12-04 11:03:55,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5fea723f >2013-12-04 11:03:55,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c42aa4e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b823cd0c}, log id: 5fea723f >2013-12-04 11:04:00,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5a16d1e5 >2013-12-04 11:04:01,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a16d1e5 >2013-12-04 11:04:01,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 325b25d6 >2013-12-04 11:04:01,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6aecc691, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@882a7291}, log id: 325b25d6 >2013-12-04 11:04:06,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 774f5be0 >2013-12-04 11:04:07,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 774f5be0 >2013-12-04 11:04:07,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 56a94930 >2013-12-04 11:04:07,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea97c8d0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46ab4de7}, log id: 56a94930 >2013-12-04 11:04:12,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4e349ec5 >2013-12-04 11:04:13,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4e349ec5 >2013-12-04 11:04:13,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e18f463 >2013-12-04 11:04:13,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad953d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22764589}, log id: 3e18f463 >2013-12-04 11:04:18,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 933152c >2013-12-04 11:04:19,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 933152c >2013-12-04 11:04:19,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 22819c19 >2013-12-04 11:04:19,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce339792, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abb42e03}, log id: 22819c19 >2013-12-04 11:04:20,636 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-04 11:04:20,637 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:04:20,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7cba8da5 >2013-12-04 11:04:20,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7cba8da5 >2013-12-04 11:04:24,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3de93c8a >2013-12-04 11:04:24,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3de93c8a >2013-12-04 11:04:24,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 322bbc80 >2013-12-04 11:04:25,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a91d5d09, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a892c2b2}, log id: 322bbc80 >2013-12-04 11:04:30,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 364d1046 >2013-12-04 11:04:30,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 364d1046 >2013-12-04 11:04:30,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3fd7c245 >2013-12-04 11:04:30,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49e33ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c745888c}, log id: 3fd7c245 >2013-12-04 11:04:36,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 279f311 >2013-12-04 11:04:36,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 279f311 >2013-12-04 11:04:36,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4e251913 >2013-12-04 11:04:36,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98710827, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6a20b8f}, log id: 4e251913 >2013-12-04 11:04:41,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29f4daa4 >2013-12-04 11:04:42,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 29f4daa4 >2013-12-04 11:04:42,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e76e06f >2013-12-04 11:04:42,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f39eb9bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cb2a092}, log id: 7e76e06f >2013-12-04 11:04:46,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5aa5f71a >2013-12-04 11:04:46,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@103071f8, log id: 5aa5f71a >2013-12-04 11:04:46,596 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-23) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:04:46,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c8a5915 >2013-12-04 11:04:46,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@25240677, log id: 5c8a5915 >2013-12-04 11:04:47,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ad29bb0 >2013-12-04 11:04:48,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: ad29bb0 >2013-12-04 11:04:48,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 77d97752 >2013-12-04 11:04:48,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b70e320, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29e9c71}, log id: 77d97752 >2013-12-04 11:04:53,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6df57a7e >2013-12-04 11:04:53,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6df57a7e >2013-12-04 11:04:54,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2b5090a3 >2013-12-04 11:04:54,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31f01e7a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b5ba2dc}, log id: 2b5090a3 >2013-12-04 11:04:59,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 877edb >2013-12-04 11:04:59,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 877edb >2013-12-04 11:04:59,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 71cefba5 >2013-12-04 11:05:00,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da885b56, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d76c60aa}, log id: 71cefba5 >2013-12-04 11:05:05,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53bd5dd >2013-12-04 11:05:05,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 53bd5dd >2013-12-04 11:05:05,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18d14667 >2013-12-04 11:05:05,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3ffad6f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f312398d}, log id: 18d14667 >2013-12-04 11:05:10,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 247d4069 >2013-12-04 11:05:11,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 247d4069 >2013-12-04 11:05:11,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2277672c >2013-12-04 11:05:11,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d216eda0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@843b34b8}, log id: 2277672c >2013-12-04 11:05:16,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1eb52e3d >2013-12-04 11:05:17,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1eb52e3d >2013-12-04 11:05:17,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 58cb045d >2013-12-04 11:05:17,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c90d55d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd962150}, log id: 58cb045d >2013-12-04 11:05:20,958 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-04 11:05:20,959 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:05:20,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20e317d7 >2013-12-04 11:05:21,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: 20e317d7 >2013-12-04 11:05:22,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 796bf05a >2013-12-04 11:05:23,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 796bf05a >2013-12-04 11:05:23,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48fe3fdb >2013-12-04 11:05:23,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@678098fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edea52d4}, log id: 48fe3fdb >2013-12-04 11:05:28,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3f244916 >2013-12-04 11:05:28,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3f244916 >2013-12-04 11:05:28,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38eed5e3 >2013-12-04 11:05:29,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e1da81a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cad8fd32}, log id: 38eed5e3 >2013-12-04 11:05:34,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 564cc93e >2013-12-04 11:05:34,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 564cc93e >2013-12-04 11:05:34,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4857f8aa >2013-12-04 11:05:34,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@caa4f603, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b96c7f8d}, log id: 4857f8aa >2013-12-04 11:05:40,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 427675ed >2013-12-04 11:05:40,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 427675ed >2013-12-04 11:05:40,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39bdbb0e >2013-12-04 11:05:40,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ef98867, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89b51e87}, log id: 39bdbb0e >2013-12-04 11:05:45,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3de938 >2013-12-04 11:05:46,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3de938 >2013-12-04 11:05:46,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4166f939 >2013-12-04 11:05:46,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61eb2e31, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ceef746}, log id: 4166f939 >2013-12-04 11:05:51,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1be47553 >2013-12-04 11:05:52,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1be47553 >2013-12-04 11:05:52,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 549655e3 >2013-12-04 11:05:52,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d89f091b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40e14a39}, log id: 549655e3 >2013-12-04 11:05:57,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53674f2f >2013-12-04 11:05:57,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 53674f2f >2013-12-04 11:05:58,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d1f8dc2 >2013-12-04 11:05:58,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5eeb6fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33656f73}, log id: 3d1f8dc2 >2013-12-04 11:06:03,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3c191d99 >2013-12-04 11:06:03,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3c191d99 >2013-12-04 11:06:03,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45d66fba >2013-12-04 11:06:04,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c14549b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ac7fbc7}, log id: 45d66fba >2013-12-04 11:06:09,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 26614709 >2013-12-04 11:06:09,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 26614709 >2013-12-04 11:06:09,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 12789d6a >2013-12-04 11:06:09,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a677e940, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8daaed46}, log id: 12789d6a >2013-12-04 11:06:14,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63d04c2 >2013-12-04 11:06:15,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 63d04c2 >2013-12-04 11:06:15,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f75ebcb >2013-12-04 11:06:15,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5661f186, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68bfc39a}, log id: 1f75ebcb >2013-12-04 11:06:20,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 44a4b21f >2013-12-04 11:06:21,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 44a4b21f >2013-12-04 11:06:21,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 14270871 >2013-12-04 11:06:21,276 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-04 11:06:21,276 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:06:21,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 30c7a93 >2013-12-04 11:06:21,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39121f66, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ea5ecd6}, log id: 14270871 >2013-12-04 11:06:21,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 30c7a93 >2013-12-04 11:06:26,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e5c3259 >2013-12-04 11:06:27,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1e5c3259 >2013-12-04 11:06:27,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 286fbffb >2013-12-04 11:06:27,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4986ad25, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50aca28f}, log id: 286fbffb >2013-12-04 11:06:32,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1bf7209e >2013-12-04 11:06:32,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bf7209e >2013-12-04 11:06:32,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2ee64a0f >2013-12-04 11:06:33,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9e4afcd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@238aa975}, log id: 2ee64a0f >2013-12-04 11:06:38,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d80591e >2013-12-04 11:06:38,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5d80591e >2013-12-04 11:06:38,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6612fced >2013-12-04 11:06:38,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b9a3578, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb926f36}, log id: 6612fced >2013-12-04 11:06:43,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 37b37a19 >2013-12-04 11:06:44,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 37b37a19 >2013-12-04 11:06:44,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 36780919 >2013-12-04 11:06:44,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d5ea389, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c9e0d4}, log id: 36780919 >2013-12-04 11:06:49,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4043434f >2013-12-04 11:06:50,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4043434f >2013-12-04 11:06:50,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 28d73244 >2013-12-04 11:06:50,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b7df010, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95d51d7b}, log id: 28d73244 >2013-12-04 11:06:55,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 17a467e >2013-12-04 11:06:56,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 17a467e >2013-12-04 11:06:56,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 36d5e3ce >2013-12-04 11:06:56,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8286b6c8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@229c00c4}, log id: 36d5e3ce >2013-12-04 11:07:01,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 69e265c7 >2013-12-04 11:07:02,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 69e265c7 >2013-12-04 11:07:02,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 268e50a >2013-12-04 11:07:02,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98952343, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@740f6192}, log id: 268e50a >2013-12-04 11:07:07,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c7646d8 >2013-12-04 11:07:07,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6c7646d8 >2013-12-04 11:07:07,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6412cca6 >2013-12-04 11:07:08,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf412ac3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c494946}, log id: 6412cca6 >2013-12-04 11:07:13,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1bcb00d8 >2013-12-04 11:07:13,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1bcb00d8 >2013-12-04 11:07:13,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40d4664e >2013-12-04 11:07:13,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2a474ac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20bf84e2}, log id: 40d4664e >2013-12-04 11:07:18,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 42f11c8 >2013-12-04 11:07:19,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 42f11c8 >2013-12-04 11:07:19,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 633ef9f4 >2013-12-04 11:07:19,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db2bc7d2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8681edb}, log id: 633ef9f4 >2013-12-04 11:07:21,578 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-04 11:07:21,578 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:07:21,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: afc3301 >2013-12-04 11:07:21,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: afc3301 >2013-12-04 11:07:24,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2fd84ff1 >2013-12-04 11:07:25,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fd84ff1 >2013-12-04 11:07:25,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1ea223a1 >2013-12-04 11:07:25,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a87903b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76cdd59e}, log id: 1ea223a1 >2013-12-04 11:07:30,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ba9a60b >2013-12-04 11:07:31,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5ba9a60b >2013-12-04 11:07:31,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32b3bd33 >2013-12-04 11:07:31,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d833eecd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84c1d341}, log id: 32b3bd33 >2013-12-04 11:07:36,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 307911d5 >2013-12-04 11:07:37,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 307911d5 >2013-12-04 11:07:37,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3395bc85 >2013-12-04 11:07:37,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a215e18, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fe22ebc}, log id: 3395bc85 >2013-12-04 11:07:42,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b35c14b >2013-12-04 11:07:42,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b35c14b >2013-12-04 11:07:42,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5550fd3e >2013-12-04 11:07:43,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c6db2b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb25fa77}, log id: 5550fd3e >2013-12-04 11:07:48,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e63ec05 >2013-12-04 11:07:48,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e63ec05 >2013-12-04 11:07:48,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1731d5fb >2013-12-04 11:07:48,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a75605b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74a99fc0}, log id: 1731d5fb >2013-12-04 11:07:53,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6268edfc >2013-12-04 11:07:54,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6268edfc >2013-12-04 11:07:54,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 286e0c02 >2013-12-04 11:07:54,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7d862e7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6561b7f4}, log id: 286e0c02 >2013-12-04 11:07:59,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1d7c385c >2013-12-04 11:08:00,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d7c385c >2013-12-04 11:08:00,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 56cd5d37 >2013-12-04 11:08:00,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4262e773, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2e8e7cd}, log id: 56cd5d37 >2013-12-04 11:08:05,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 58580f1b >2013-12-04 11:08:06,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 58580f1b >2013-12-04 11:08:06,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 23731dbc >2013-12-04 11:08:06,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87e7dd24, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d84e0dc}, log id: 23731dbc >2013-12-04 11:08:11,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1755b72b >2013-12-04 11:08:11,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1755b72b >2013-12-04 11:08:11,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 41d4944 >2013-12-04 11:08:12,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd2d3c2e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd430028}, log id: 41d4944 >2013-12-04 11:08:17,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 624a48e3 >2013-12-04 11:08:17,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 624a48e3 >2013-12-04 11:08:17,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d96be47 >2013-12-04 11:08:17,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6af21a2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27173dad}, log id: d96be47 >2013-12-04 11:08:21,906 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-04 11:08:21,907 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:08:21,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 72e12964 >2013-12-04 11:08:22,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 72e12964 >2013-12-04 11:08:23,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79b269a8 >2013-12-04 11:08:23,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 79b269a8 >2013-12-04 11:08:23,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27b29e9 >2013-12-04 11:08:23,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73c35cf5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b296df63}, log id: 27b29e9 >2013-12-04 11:08:28,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 370d0e52 >2013-12-04 11:08:29,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 370d0e52 >2013-12-04 11:08:29,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e8817d2 >2013-12-04 11:08:29,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2adeed0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2fd4126}, log id: 4e8817d2 >2013-12-04 11:08:34,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7bc7f632 >2013-12-04 11:08:35,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7bc7f632 >2013-12-04 11:08:35,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f0160b3 >2013-12-04 11:08:35,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50eed9be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c83471b4}, log id: 5f0160b3 >2013-12-04 11:08:40,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39afd383 >2013-12-04 11:08:40,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 39afd383 >2013-12-04 11:08:40,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 86af489 >2013-12-04 11:08:41,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6e1f7e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40f65f54}, log id: 86af489 >2013-12-04 11:08:46,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4bc0ce48 >2013-12-04 11:08:46,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4bc0ce48 >2013-12-04 11:08:46,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 153d9d99 >2013-12-04 11:08:47,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5110ffc1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63101037}, log id: 153d9d99 >2013-12-04 11:08:52,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 766c4000 >2013-12-04 11:08:52,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 766c4000 >2013-12-04 11:08:52,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d747b86 >2013-12-04 11:08:52,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64cdf165, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b23c4239}, log id: d747b86 >2013-12-04 11:08:57,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 652674e >2013-12-04 11:08:58,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 652674e >2013-12-04 11:08:58,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 528a7852 >2013-12-04 11:08:58,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6540f2f8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4ac1972}, log id: 528a7852 >2013-12-04 11:09:03,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7f97f515 >2013-12-04 11:09:04,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7f97f515 >2013-12-04 11:09:04,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3dd0719 >2013-12-04 11:09:04,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c2e3582, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7af6bafa}, log id: 3dd0719 >2013-12-04 11:09:09,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 65e0468d >2013-12-04 11:09:10,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 65e0468d >2013-12-04 11:09:10,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 57ab67ef >2013-12-04 11:09:10,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a228897f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec2a4514}, log id: 57ab67ef >2013-12-04 11:09:15,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2532fca9 >2013-12-04 11:09:15,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2532fca9 >2013-12-04 11:09:15,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 60f5acf8 >2013-12-04 11:09:16,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbd72aaf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd3e4bc6}, log id: 60f5acf8 >2013-12-04 11:09:21,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 23ff4da8 >2013-12-04 11:09:21,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 23ff4da8 >2013-12-04 11:09:21,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 54a33a74 >2013-12-04 11:09:21,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20480a2e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77cdadee}, log id: 54a33a74 >2013-12-04 11:09:22,228 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-04 11:09:22,229 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:09:22,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5f1c52e >2013-12-04 11:09:22,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5f1c52e >2013-12-04 11:09:27,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 470fedab >2013-12-04 11:09:27,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 470fedab >2013-12-04 11:09:27,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4802edc1 >2013-12-04 11:09:27,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@970b41e3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db945137}, log id: 4802edc1 >2013-12-04 11:09:32,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 494de19e >2013-12-04 11:09:33,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 494de19e >2013-12-04 11:09:33,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5d6e7056 >2013-12-04 11:09:33,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bf9f01d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5a29cbc}, log id: 5d6e7056 >2013-12-04 11:09:38,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4a812046 >2013-12-04 11:09:39,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a812046 >2013-12-04 11:09:39,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 213a66fe >2013-12-04 11:09:39,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@437a3ebc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@649f038c}, log id: 213a66fe >2013-12-04 11:09:44,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 427e705b >2013-12-04 11:09:45,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 427e705b >2013-12-04 11:09:45,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63cc9319 >2013-12-04 11:09:45,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a98960c3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88c8067d}, log id: 63cc9319 >2013-12-04 11:09:46,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 264b9ae3 >2013-12-04 11:09:47,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3f6f667, log id: 264b9ae3 >2013-12-04 11:09:47,214 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-35) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:09:47,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4aaae639 >2013-12-04 11:09:47,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2d43f4b0, log id: 4aaae639 >2013-12-04 11:09:50,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 16af4788 >2013-12-04 11:09:50,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 16af4788 >2013-12-04 11:09:50,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b915f34 >2013-12-04 11:09:51,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db285baa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef85bea5}, log id: 1b915f34 >2013-12-04 11:09:56,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6dd74c87 >2013-12-04 11:09:56,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6dd74c87 >2013-12-04 11:09:56,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6b3e8764 >2013-12-04 11:09:56,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de686735, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b0ce40}, log id: 6b3e8764 >2013-12-04 11:10:01,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2fbacffa >2013-12-04 11:10:02,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2fbacffa >2013-12-04 11:10:02,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2243f861 >2013-12-04 11:10:02,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c17c7e1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b763b695}, log id: 2243f861 >2013-12-04 11:10:07,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5dbecd64 >2013-12-04 11:10:08,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5dbecd64 >2013-12-04 11:10:08,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2a5c3f89 >2013-12-04 11:10:08,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@748e1713, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3423bce6}, log id: 2a5c3f89 >2013-12-04 11:10:13,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d77cf65 >2013-12-04 11:10:14,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4d77cf65 >2013-12-04 11:10:14,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6efab9e9 >2013-12-04 11:10:14,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88067edb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c73cd25c}, log id: 6efab9e9 >2013-12-04 11:10:19,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a90051c >2013-12-04 11:10:19,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4a90051c >2013-12-04 11:10:19,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 22fb474e >2013-12-04 11:10:20,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@120fd4be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c69bd38}, log id: 22fb474e >2013-12-04 11:10:22,521 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-04 11:10:22,521 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:10:22,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 56cdfc16 >2013-12-04 11:10:22,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 56cdfc16 >2013-12-04 11:10:25,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 265f8689 >2013-12-04 11:10:25,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 265f8689 >2013-12-04 11:10:25,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a72a4e7 >2013-12-04 11:10:26,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4284896, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ac9c22c}, log id: 3a72a4e7 >2013-12-04 11:10:31,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 359a8207 >2013-12-04 11:10:31,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 359a8207 >2013-12-04 11:10:31,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 52717ee >2013-12-04 11:10:31,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77d821c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0474cc4}, log id: 52717ee >2013-12-04 11:10:36,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4f41287a >2013-12-04 11:10:37,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4f41287a >2013-12-04 11:10:37,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69edb4a >2013-12-04 11:10:37,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efd37c58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1948f9bf}, log id: 69edb4a >2013-12-04 11:10:42,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3c43fd75 >2013-12-04 11:10:43,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3c43fd75 >2013-12-04 11:10:43,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c82c52e >2013-12-04 11:10:43,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7c7c6fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@767adefc}, log id: 6c82c52e >2013-12-04 11:10:48,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 534c3219 >2013-12-04 11:10:49,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 534c3219 >2013-12-04 11:10:49,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5e8fc9c5 >2013-12-04 11:10:49,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee08cf31, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@125f3ee9}, log id: 5e8fc9c5 >2013-12-04 11:10:54,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10b15a96 >2013-12-04 11:10:54,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 10b15a96 >2013-12-04 11:10:54,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6e3e9887 >2013-12-04 11:10:55,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb288d1d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@118fbd28}, log id: 6e3e9887 >2013-12-04 11:11:00,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30710307 >2013-12-04 11:11:00,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 30710307 >2013-12-04 11:11:00,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35aec314 >2013-12-04 11:11:01,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41973f9f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1baa7dce}, log id: 35aec314 >2013-12-04 11:11:06,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78220a34 >2013-12-04 11:11:06,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 78220a34 >2013-12-04 11:11:06,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 51da3e44 >2013-12-04 11:11:06,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26223807, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@730dd73a}, log id: 51da3e44 >2013-12-04 11:11:11,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 78f0646d >2013-12-04 11:11:12,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 78f0646d >2013-12-04 11:11:12,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56fc4078 >2013-12-04 11:11:12,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ff9f81c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be359638}, log id: 56fc4078 >2013-12-04 11:11:17,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58578148 >2013-12-04 11:11:18,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 58578148 >2013-12-04 11:11:18,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 61b22244 >2013-12-04 11:11:18,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11510150, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4f3fbf5}, log id: 61b22244 >2013-12-04 11:11:22,838 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) No up server in cluster >2013-12-04 11:11:22,839 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:11:22,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10936003 >2013-12-04 11:11:23,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterTasksListVDSCommand, return: [], log id: 10936003 >2013-12-04 11:11:23,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 285e09b7 >2013-12-04 11:11:24,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 285e09b7 >2013-12-04 11:11:24,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 28e947f4 >2013-12-04 11:11:24,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff9ae168, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9999ef50}, log id: 28e947f4 >2013-12-04 11:11:29,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 145e699f >2013-12-04 11:11:29,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 145e699f >2013-12-04 11:11:29,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e62a00e >2013-12-04 11:11:30,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fb8c842, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da0fd591}, log id: 2e62a00e >2013-12-04 11:11:35,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2e4c50 >2013-12-04 11:11:35,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e4c50 >2013-12-04 11:11:35,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: bc5bddc >2013-12-04 11:11:36,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb4e9c89, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@805f28f3}, log id: bc5bddc >2013-12-04 11:11:41,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5083acc1 >2013-12-04 11:11:41,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5083acc1 >2013-12-04 11:11:41,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 673d01a1 >2013-12-04 11:11:41,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2766534f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44d6b92e}, log id: 673d01a1 >2013-12-04 11:11:46,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46287082 >2013-12-04 11:11:47,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 46287082 >2013-12-04 11:11:47,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d9530fb >2013-12-04 11:11:47,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd47f974, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54040ed7}, log id: 1d9530fb >2013-12-04 11:11:52,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a76f406 >2013-12-04 11:11:53,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1a76f406 >2013-12-04 11:11:53,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27b6a258 >2013-12-04 11:11:53,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1d28642, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bddcf1bc}, log id: 27b6a258 >2013-12-04 11:11:58,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 619355fe >2013-12-04 11:11:59,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 619355fe >2013-12-04 11:11:59,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 31475211 >2013-12-04 11:11:59,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b18551db, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b22385e9}, log id: 31475211 >2013-12-04 11:12:04,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 507c90bc >2013-12-04 11:12:04,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 507c90bc >2013-12-04 11:12:04,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 43cf9aad >2013-12-04 11:12:05,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9cbc0af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5a071eb}, log id: 43cf9aad >2013-12-04 11:12:10,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 364fbc6d >2013-12-04 11:12:10,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 364fbc6d >2013-12-04 11:12:10,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 895e30f >2013-12-04 11:12:11,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23af7313, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@146b9105}, log id: 895e30f >2013-12-04 11:12:16,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 751114e9 >2013-12-04 11:12:16,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 751114e9 >2013-12-04 11:12:16,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f4219ab >2013-12-04 11:12:16,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82eea80f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c95b1389}, log id: 5f4219ab >2013-12-04 11:12:21,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6f8dddc5 >2013-12-04 11:12:22,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f8dddc5 >2013-12-04 11:12:22,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 78446e45 >2013-12-04 11:12:22,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccc36ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99bd048b}, log id: 78446e45 >2013-12-04 11:12:23,151 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) No up server in cluster >2013-12-04 11:12:23,151 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:12:23,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41c38d71 >2013-12-04 11:12:23,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterTasksListVDSCommand, return: [], log id: 41c38d71 >2013-12-04 11:12:28,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1db3eb01 >2013-12-04 11:12:28,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1db3eb01 >2013-12-04 11:12:28,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a31acf9 >2013-12-04 11:12:28,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffc4b125, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78aeed5b}, log id: 4a31acf9 >2013-12-04 11:12:33,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1b8880e0 >2013-12-04 11:12:34,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1b8880e0 >2013-12-04 11:12:34,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1b700d66 >2013-12-04 11:12:34,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@959f2d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd2bbe6c}, log id: 1b700d66 >2013-12-04 11:12:39,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c970833 >2013-12-04 11:12:40,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2c970833 >2013-12-04 11:12:40,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3aa8f5bf >2013-12-04 11:12:40,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46d8142, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9eaf38f}, log id: 3aa8f5bf >2013-12-04 11:12:45,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3b4351bc >2013-12-04 11:12:46,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3b4351bc >2013-12-04 11:12:46,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 418fe93f >2013-12-04 11:12:46,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90be04c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fea65e6d}, log id: 418fe93f >2013-12-04 11:12:51,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3f60e11c >2013-12-04 11:12:51,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3f60e11c >2013-12-04 11:12:51,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3bbcc6dd >2013-12-04 11:12:52,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6044840, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2682a440}, log id: 3bbcc6dd >2013-12-04 11:12:57,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5bc389d0 >2013-12-04 11:12:57,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5bc389d0 >2013-12-04 11:12:57,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a57068b >2013-12-04 11:12:57,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ddf25fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a30f7ee0}, log id: 7a57068b >2013-12-04 11:13:03,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 78dad469 >2013-12-04 11:13:03,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 78dad469 >2013-12-04 11:13:03,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 30b1a8ba >2013-12-04 11:13:03,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4513f58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3561ed0e}, log id: 30b1a8ba >2013-12-04 11:13:08,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1255346b >2013-12-04 11:13:09,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1255346b >2013-12-04 11:13:09,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 32996008 >2013-12-04 11:13:09,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac6df7f0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ed26eaf}, log id: 32996008 >2013-12-04 11:13:14,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4e01b794 >2013-12-04 11:13:15,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e01b794 >2013-12-04 11:13:15,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1a821c1c >2013-12-04 11:13:15,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17fb2ff5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fcd70a3}, log id: 1a821c1c >2013-12-04 11:13:20,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 65617e14 >2013-12-04 11:13:20,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 65617e14 >2013-12-04 11:13:20,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7aff7371 >2013-12-04 11:13:21,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f3bfe25, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bad34c11}, log id: 7aff7371 >2013-12-04 11:13:23,536 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-04 11:13:23,536 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:13:23,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 529f4565 >2013-12-04 11:13:23,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 529f4565 >2013-12-04 11:13:26,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6141c5ac >2013-12-04 11:13:26,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6141c5ac >2013-12-04 11:13:26,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 63122e4f >2013-12-04 11:13:27,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac9c438c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f81cb944}, log id: 63122e4f >2013-12-04 11:13:32,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 43ad314e >2013-12-04 11:13:32,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 43ad314e >2013-12-04 11:13:32,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 61820e05 >2013-12-04 11:13:32,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c049642, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@832d8c32}, log id: 61820e05 >2013-12-04 11:13:37,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 46c98ad9 >2013-12-04 11:13:38,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 46c98ad9 >2013-12-04 11:13:38,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: db7784a >2013-12-04 11:13:38,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75c9de9c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32df71aa}, log id: db7784a >2013-12-04 11:13:43,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 33b58bea >2013-12-04 11:13:44,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 33b58bea >2013-12-04 11:13:44,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 323b0b0d >2013-12-04 11:13:44,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c7d1522, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0f3a466}, log id: 323b0b0d >2013-12-04 11:13:49,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 34683d67 >2013-12-04 11:13:50,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 34683d67 >2013-12-04 11:13:50,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5d3b5e33 >2013-12-04 11:13:50,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@554ac18d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffb0afdc}, log id: 5d3b5e33 >2013-12-04 11:13:55,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 32f92537 >2013-12-04 11:13:55,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 32f92537 >2013-12-04 11:13:55,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 21f6d3fc >2013-12-04 11:13:56,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@394a39ff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba76d111}, log id: 21f6d3fc >2013-12-04 11:14:01,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40f4609d >2013-12-04 11:14:01,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 40f4609d >2013-12-04 11:14:01,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4782fcb8 >2013-12-04 11:14:01,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb4bec99, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36d1c139}, log id: 4782fcb8 >2013-12-04 11:14:07,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14eda2cc >2013-12-04 11:14:07,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 14eda2cc >2013-12-04 11:14:07,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d84d27c >2013-12-04 11:14:07,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42b7a327, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@920c97b9}, log id: 1d84d27c >2013-12-04 11:14:12,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 26ca9e8 >2013-12-04 11:14:13,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 26ca9e8 >2013-12-04 11:14:13,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 46f464ae >2013-12-04 11:14:13,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43d0d0fe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aca2b3}, log id: 46f464ae >2013-12-04 11:14:18,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7cda771c >2013-12-04 11:14:19,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7cda771c >2013-12-04 11:14:19,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6d518644 >2013-12-04 11:14:19,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ec71c4b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3514c18}, log id: 6d518644 >2013-12-04 11:14:23,863 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [6e7f0088] No up server in cluster >2013-12-04 11:14:23,873 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [6e7f0088] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:14:23,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 77ea5b28 >2013-12-04 11:14:24,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterTasksListVDSCommand, return: [], log id: 77ea5b28 >2013-12-04 11:14:24,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 24b41365 >2013-12-04 11:14:24,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 24b41365 >2013-12-04 11:14:24,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 19a966b6 >2013-12-04 11:14:25,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c18d0421, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@290da2da}, log id: 19a966b6 >2013-12-04 11:14:30,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2efb09ca >2013-12-04 11:14:30,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2efb09ca >2013-12-04 11:14:30,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2e53cb9c >2013-12-04 11:14:31,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89dc0e9f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1deb2444}, log id: 2e53cb9c >2013-12-04 11:14:36,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78ac760f >2013-12-04 11:14:36,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 78ac760f >2013-12-04 11:14:36,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 75d6728 >2013-12-04 11:14:36,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89f41ff9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8109c46}, log id: 75d6728 >2013-12-04 11:14:41,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: de91a41 >2013-12-04 11:14:42,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: de91a41 >2013-12-04 11:14:42,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5137cc0f >2013-12-04 11:14:42,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a10796a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c3311ab}, log id: 5137cc0f >2013-12-04 11:14:47,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 746405 >2013-12-04 11:14:47,727 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-96) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 11:14:47,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@79840645, log id: 746405 >2013-12-04 11:14:47,794 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-83) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:14:47,802 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-96) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 11:14:47,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4ab7da56 >2013-12-04 11:14:48,033 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-96) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 11:14:48,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@292c96a2, log id: 4ab7da56 >2013-12-04 11:14:48,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2e557acc >2013-12-04 11:14:48,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e557acc >2013-12-04 11:14:48,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 14514ffc >2013-12-04 11:14:48,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@133b402, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83ad5b76}, log id: 14514ffc >2013-12-04 11:14:53,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77657546 >2013-12-04 11:14:54,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 77657546 >2013-12-04 11:14:54,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f746b8f >2013-12-04 11:14:54,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12acdf85, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d9b9c3c}, log id: 4f746b8f >2013-12-04 11:14:59,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 630df4e >2013-12-04 11:15:00,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 630df4e >2013-12-04 11:15:00,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5209371b >2013-12-04 11:15:00,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25500957, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcf0eab1}, log id: 5209371b >2013-12-04 11:15:05,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: e460e8c >2013-12-04 11:15:06,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: e460e8c >2013-12-04 11:15:06,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 513c0875 >2013-12-04 11:15:06,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4183f0c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2830cdd}, log id: 513c0875 >2013-12-04 11:15:11,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48efce53 >2013-12-04 11:15:11,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 48efce53 >2013-12-04 11:15:11,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 42dc68d8 >2013-12-04 11:15:12,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13fa51a2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65bd2d68}, log id: 42dc68d8 >2013-12-04 11:15:17,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 542471 >2013-12-04 11:15:17,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 542471 >2013-12-04 11:15:17,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4f4ce801 >2013-12-04 11:15:17,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eea10baa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d5c1f5e}, log id: 4f4ce801 >2013-12-04 11:15:22,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 71c1ab62 >2013-12-04 11:15:23,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 71c1ab62 >2013-12-04 11:15:23,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3561bce3 >2013-12-04 11:15:23,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b51ae992, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9276c996}, log id: 3561bce3 >2013-12-04 11:15:24,206 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-04 11:15:24,206 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:15:24,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 59060632 >2013-12-04 11:15:24,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 59060632 >2013-12-04 11:15:28,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37518d80 >2013-12-04 11:15:29,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 37518d80 >2013-12-04 11:15:29,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68ce8501 >2013-12-04 11:15:29,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fb5df2c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1743ce13}, log id: 68ce8501 >2013-12-04 11:15:34,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d467ac5 >2013-12-04 11:15:35,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4d467ac5 >2013-12-04 11:15:35,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 20fe470 >2013-12-04 11:15:35,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d3a045d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa43a81d}, log id: 20fe470 >2013-12-04 11:15:40,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 622d903c >2013-12-04 11:15:40,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 622d903c >2013-12-04 11:15:40,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b79b18b >2013-12-04 11:15:41,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@694f77c3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb5fa8ac}, log id: 5b79b18b >2013-12-04 11:15:46,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1959d1d4 >2013-12-04 11:15:46,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1959d1d4 >2013-12-04 11:15:46,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63edb17d >2013-12-04 11:15:47,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c801f6f0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b443a63}, log id: 63edb17d >2013-12-04 11:15:52,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 619502c >2013-12-04 11:15:52,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 619502c >2013-12-04 11:15:52,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7717dfca >2013-12-04 11:15:52,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b3668dc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abec0734}, log id: 7717dfca >2013-12-04 11:15:57,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1f212632 >2013-12-04 11:15:58,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1f212632 >2013-12-04 11:15:58,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c957766 >2013-12-04 11:15:58,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c3d2b87, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@344ff11}, log id: 6c957766 >2013-12-04 11:16:03,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4fcdc629 >2013-12-04 11:16:04,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4fcdc629 >2013-12-04 11:16:04,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b68ec75 >2013-12-04 11:16:04,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cb1b0e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27308fa7}, log id: 1b68ec75 >2013-12-04 11:16:09,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: bde682c >2013-12-04 11:16:10,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: bde682c >2013-12-04 11:16:10,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f7826a5 >2013-12-04 11:16:10,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1e9f15e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbd0315}, log id: 1f7826a5 >2013-12-04 11:16:15,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d9831d6 >2013-12-04 11:16:15,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7d9831d6 >2013-12-04 11:16:15,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 337cf8a2 >2013-12-04 11:16:16,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8eb57bf8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe82caf4}, log id: 337cf8a2 >2013-12-04 11:16:21,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 36f1854b >2013-12-04 11:16:21,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36f1854b >2013-12-04 11:16:21,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 185956bd >2013-12-04 11:16:22,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe56c2b0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@859e65d2}, log id: 185956bd >2013-12-04 11:16:24,520 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-04 11:16:24,521 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:16:24,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2ccf526b >2013-12-04 11:16:24,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2ccf526b >2013-12-04 11:16:27,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2c34787a >2013-12-04 11:16:27,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c34787a >2013-12-04 11:16:27,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 75c507c8 >2013-12-04 11:16:27,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0af4754, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ccd3e10}, log id: 75c507c8 >2013-12-04 11:16:32,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7dce4371 >2013-12-04 11:16:33,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7dce4371 >2013-12-04 11:16:33,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 12001730 >2013-12-04 11:16:33,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aeff064c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74da505c}, log id: 12001730 >2013-12-04 11:16:38,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 697c2318 >2013-12-04 11:16:39,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 697c2318 >2013-12-04 11:16:39,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2a834e82 >2013-12-04 11:16:39,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d7ee158, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7900ebd0}, log id: 2a834e82 >2013-12-04 11:16:44,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 78d893f5 >2013-12-04 11:16:45,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 78d893f5 >2013-12-04 11:16:45,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5489e8b6 >2013-12-04 11:16:45,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b41ffe4f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@455f55f8}, log id: 5489e8b6 >2013-12-04 11:16:50,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 711b241a >2013-12-04 11:16:50,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 711b241a >2013-12-04 11:16:50,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 59f341f3 >2013-12-04 11:16:51,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25a39448, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0cbce20}, log id: 59f341f3 >2013-12-04 11:16:56,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 68db3db3 >2013-12-04 11:16:56,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 68db3db3 >2013-12-04 11:16:56,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c073932 >2013-12-04 11:16:57,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@928275dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ddb0be6}, log id: 5c073932 >2013-12-04 11:17:02,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 340c1e1b >2013-12-04 11:17:02,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 340c1e1b >2013-12-04 11:17:02,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 42313098 >2013-12-04 11:17:02,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7bbab72, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7cc3f31}, log id: 42313098 >2013-12-04 11:17:07,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 243b51bf >2013-12-04 11:17:08,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 243b51bf >2013-12-04 11:17:08,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20244558 >2013-12-04 11:17:08,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50fcd105, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c236f90}, log id: 20244558 >2013-12-04 11:17:13,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7c4aa00b >2013-12-04 11:17:14,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7c4aa00b >2013-12-04 11:17:14,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 206e418 >2013-12-04 11:17:14,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4eeaa15, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc66d473}, log id: 206e418 >2013-12-04 11:17:19,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 17aff31b >2013-12-04 11:17:20,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 17aff31b >2013-12-04 11:17:20,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14314248 >2013-12-04 11:17:20,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f621bf9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8d76c68}, log id: 14314248 >2013-12-04 11:17:24,827 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-04 11:17:24,828 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:17:24,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7b1199bc >2013-12-04 11:17:25,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7b1199bc >2013-12-04 11:17:25,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: b123b1f >2013-12-04 11:17:25,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: b123b1f >2013-12-04 11:17:25,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6a0521b7 >2013-12-04 11:17:26,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bb24a7c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf249cff}, log id: 6a0521b7 >2013-12-04 11:17:31,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1e66ff93 >2013-12-04 11:17:31,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1e66ff93 >2013-12-04 11:17:31,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2ac83f2b >2013-12-04 11:17:31,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c74faf55, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2982d14f}, log id: 2ac83f2b >2013-12-04 11:17:36,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c878476 >2013-12-04 11:17:37,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5c878476 >2013-12-04 11:17:37,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 73b50975 >2013-12-04 11:17:37,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35adae1e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5731319}, log id: 73b50975 >2013-12-04 11:17:42,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 47d7cee3 >2013-12-04 11:17:43,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 47d7cee3 >2013-12-04 11:17:43,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7b85f6fb >2013-12-04 11:17:43,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4504cd97, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@deda01c3}, log id: 7b85f6fb >2013-12-04 11:17:48,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 51d97d31 >2013-12-04 11:17:49,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 51d97d31 >2013-12-04 11:17:49,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37c1143e >2013-12-04 11:17:49,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cfcd699, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33fc2b5e}, log id: 37c1143e >2013-12-04 11:17:54,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: c92718f >2013-12-04 11:17:54,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: c92718f >2013-12-04 11:17:54,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2979194b >2013-12-04 11:17:55,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0a67061, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@935cab55}, log id: 2979194b >2013-12-04 11:18:00,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6bcc7d90 >2013-12-04 11:18:00,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6bcc7d90 >2013-12-04 11:18:00,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39762dc1 >2013-12-04 11:18:01,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38b1101e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f33929eb}, log id: 39762dc1 >2013-12-04 11:18:06,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1eb5054b >2013-12-04 11:18:06,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1eb5054b >2013-12-04 11:18:06,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5805180c >2013-12-04 11:18:06,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74ee750b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cf024c2}, log id: 5805180c >2013-12-04 11:18:11,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1904663d >2013-12-04 11:18:12,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1904663d >2013-12-04 11:18:12,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 333b1381 >2013-12-04 11:18:12,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a42cd23b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42f550c7}, log id: 333b1381 >2013-12-04 11:18:17,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 85e42ee >2013-12-04 11:18:18,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 85e42ee >2013-12-04 11:18:18,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2e7a284f >2013-12-04 11:18:18,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbb1bca8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e107641}, log id: 2e7a284f >2013-12-04 11:18:23,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b52a42c >2013-12-04 11:18:24,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6b52a42c >2013-12-04 11:18:24,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19b3a897 >2013-12-04 11:18:24,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb59f7ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3967adeb}, log id: 19b3a897 >2013-12-04 11:18:25,120 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-04 11:18:25,120 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:18:25,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 78f33b88 >2013-12-04 11:18:25,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 78f33b88 >2013-12-04 11:18:29,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6a95026b >2013-12-04 11:18:29,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6a95026b >2013-12-04 11:18:29,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5dcc15b >2013-12-04 11:18:30,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50f46b20, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2dc6c566}, log id: 5dcc15b >2013-12-04 11:18:35,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 76299f4a >2013-12-04 11:18:35,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 76299f4a >2013-12-04 11:18:35,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1feeb128 >2013-12-04 11:18:35,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f185df73, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f2a7ff4}, log id: 1feeb128 >2013-12-04 11:18:41,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3375f424 >2013-12-04 11:18:41,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3375f424 >2013-12-04 11:18:41,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a1ea41a >2013-12-04 11:18:41,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@576494fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2beef7aa}, log id: 3a1ea41a >2013-12-04 11:18:46,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7773541b >2013-12-04 11:18:47,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7773541b >2013-12-04 11:18:47,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1bc9497d >2013-12-04 11:18:47,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95616b56, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cea0d4a}, log id: 1bc9497d >2013-12-04 11:18:52,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5d28c8a8 >2013-12-04 11:18:53,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5d28c8a8 >2013-12-04 11:18:53,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 521d87d0 >2013-12-04 11:18:53,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1838dc5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d17785b8}, log id: 521d87d0 >2013-12-04 11:18:58,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 51b7682 >2013-12-04 11:18:58,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 51b7682 >2013-12-04 11:18:58,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2618186e >2013-12-04 11:18:59,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f96b0aae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b74bcb2c}, log id: 2618186e >2013-12-04 11:19:04,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6398d288 >2013-12-04 11:19:04,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6398d288 >2013-12-04 11:19:04,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fb35f70 >2013-12-04 11:19:05,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd26b6a0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ea4bf5c}, log id: 2fb35f70 >2013-12-04 11:19:10,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7063ab89 >2013-12-04 11:19:10,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7063ab89 >2013-12-04 11:19:10,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 78fd7463 >2013-12-04 11:19:10,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ef5dda5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f6e8e11}, log id: 78fd7463 >2013-12-04 11:19:15,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 16656d69 >2013-12-04 11:19:16,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 16656d69 >2013-12-04 11:19:16,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2ba931ea >2013-12-04 11:19:16,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1ac38f9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8244b51a}, log id: 2ba931ea >2013-12-04 11:19:21,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d3cedd4 >2013-12-04 11:19:22,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1d3cedd4 >2013-12-04 11:19:22,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 312d1374 >2013-12-04 11:19:22,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38e232e8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e042a646}, log id: 312d1374 >2013-12-04 11:19:25,434 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) No up server in cluster >2013-12-04 11:19:25,434 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:19:25,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 531f5f22 >2013-12-04 11:19:25,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterTasksListVDSCommand, return: [], log id: 531f5f22 >2013-12-04 11:19:27,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3af521e5 >2013-12-04 11:19:28,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3af521e5 >2013-12-04 11:19:28,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c7ec611 >2013-12-04 11:19:28,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5455e0b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd548d8b}, log id: 2c7ec611 >2013-12-04 11:19:33,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1519abca >2013-12-04 11:19:33,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1519abca >2013-12-04 11:19:33,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2dec3be0 >2013-12-04 11:19:34,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c10a4ff3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b94dd1ee}, log id: 2dec3be0 >2013-12-04 11:19:39,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 28cd6ae3 >2013-12-04 11:19:39,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 28cd6ae3 >2013-12-04 11:19:39,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d546b04 >2013-12-04 11:19:40,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c7bbf22, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5478dc6}, log id: 2d546b04 >2013-12-04 11:19:45,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6710e459 >2013-12-04 11:19:45,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6710e459 >2013-12-04 11:19:45,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 55b96849 >2013-12-04 11:19:45,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1dd1a182, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@759a9334}, log id: 55b96849 >2013-12-04 11:19:48,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5293eb95 >2013-12-04 11:19:48,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@24642034, log id: 5293eb95 >2013-12-04 11:19:48,401 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-10) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:19:48,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 297e4896 >2013-12-04 11:19:48,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@b89352a, log id: 297e4896 >2013-12-04 11:19:50,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6b4bba34 >2013-12-04 11:19:51,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6b4bba34 >2013-12-04 11:19:51,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4b66416f >2013-12-04 11:19:51,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86ce4e6f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98998ea6}, log id: 4b66416f >2013-12-04 11:19:56,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2f191d31 >2013-12-04 11:19:57,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2f191d31 >2013-12-04 11:19:57,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2bc5a850 >2013-12-04 11:19:57,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab049352, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59cde575}, log id: 2bc5a850 >2013-12-04 11:20:02,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1b77660c >2013-12-04 11:20:03,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1b77660c >2013-12-04 11:20:03,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 16c1f581 >2013-12-04 11:20:03,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20dbcc35, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3d03ee2}, log id: 16c1f581 >2013-12-04 11:20:08,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3322e313 >2013-12-04 11:20:08,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3322e313 >2013-12-04 11:20:08,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 173b928a >2013-12-04 11:20:09,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@913d3f1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f150c10}, log id: 173b928a >2013-12-04 11:20:14,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7cbda98b >2013-12-04 11:20:14,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7cbda98b >2013-12-04 11:20:14,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 107a707a >2013-12-04 11:20:15,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fff8a30, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a697fe}, log id: 107a707a >2013-12-04 11:20:20,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6498c7f5 >2013-12-04 11:20:20,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6498c7f5 >2013-12-04 11:20:20,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 12c29d37 >2013-12-04 11:20:20,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a035bd46, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cacd6af6}, log id: 12c29d37 >2013-12-04 11:20:25,751 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) [6463bdcc] No up server in cluster >2013-12-04 11:20:25,752 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) [6463bdcc] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:20:25,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2d478956 >2013-12-04 11:20:25,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 225d641a >2013-12-04 11:20:26,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterTasksListVDSCommand, return: [], log id: 2d478956 >2013-12-04 11:20:26,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 225d641a >2013-12-04 11:20:26,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40e84c14 >2013-12-04 11:20:26,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe289126, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ca868a6}, log id: 40e84c14 >2013-12-04 11:20:31,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6a0e292 >2013-12-04 11:20:32,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6a0e292 >2013-12-04 11:20:32,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3da9ba22 >2013-12-04 11:20:32,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea4f4410, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc52c142}, log id: 3da9ba22 >2013-12-04 11:20:37,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4d360310 >2013-12-04 11:20:38,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d360310 >2013-12-04 11:20:38,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 772b71d8 >2013-12-04 11:20:38,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd88fe15, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@245bf7d3}, log id: 772b71d8 >2013-12-04 11:20:43,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 34970c95 >2013-12-04 11:20:43,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 34970c95 >2013-12-04 11:20:43,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5eb305f9 >2013-12-04 11:20:44,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e74296, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cb58483}, log id: 5eb305f9 >2013-12-04 11:20:49,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6fcfb70d >2013-12-04 11:20:49,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fcfb70d >2013-12-04 11:20:49,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 368355e1 >2013-12-04 11:20:50,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1434815, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be7740c6}, log id: 368355e1 >2013-12-04 11:20:55,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6075faaa >2013-12-04 11:20:55,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6075faaa >2013-12-04 11:20:55,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 640e60d0 >2013-12-04 11:20:55,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0f11ca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6ac62c5}, log id: 640e60d0 >2013-12-04 11:21:00,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18cc0f86 >2013-12-04 11:21:01,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 18cc0f86 >2013-12-04 11:21:01,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1237390e >2013-12-04 11:21:01,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0236d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d73dcd8a}, log id: 1237390e >2013-12-04 11:21:06,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 560ce199 >2013-12-04 11:21:07,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 560ce199 >2013-12-04 11:21:07,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 12cc0149 >2013-12-04 11:21:07,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f28f2a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efb421e}, log id: 12cc0149 >2013-12-04 11:21:12,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 24ecaa4c >2013-12-04 11:21:13,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 24ecaa4c >2013-12-04 11:21:13,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2cd65f57 >2013-12-04 11:21:13,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1066eeec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2afa0d74}, log id: 2cd65f57 >2013-12-04 11:21:18,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 64a96fb6 >2013-12-04 11:21:18,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 64a96fb6 >2013-12-04 11:21:18,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3397b389 >2013-12-04 11:21:19,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@306332a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92fbaae8}, log id: 3397b389 >2013-12-04 11:21:24,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 19f5a237 >2013-12-04 11:21:24,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 19f5a237 >2013-12-04 11:21:24,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c740873 >2013-12-04 11:21:25,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a97e59f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b69cb3c}, log id: 5c740873 >2013-12-04 11:21:26,043 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) No up server in cluster >2013-12-04 11:21:26,043 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:21:26,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 53ca8dd0 >2013-12-04 11:21:26,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterTasksListVDSCommand, return: [], log id: 53ca8dd0 >2013-12-04 11:21:30,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d2afc >2013-12-04 11:21:30,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: d2afc >2013-12-04 11:21:30,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1910744e >2013-12-04 11:21:30,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@294f3db5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba2f0ee4}, log id: 1910744e >2013-12-04 11:21:35,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67544826 >2013-12-04 11:21:36,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 67544826 >2013-12-04 11:21:36,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 52e7525e >2013-12-04 11:21:36,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1614bfe8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67a261bd}, log id: 52e7525e >2013-12-04 11:21:41,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: f2a0791 >2013-12-04 11:21:42,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: f2a0791 >2013-12-04 11:21:42,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1e076d32 >2013-12-04 11:21:42,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66858457, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@113a5bc7}, log id: 1e076d32 >2013-12-04 11:21:47,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 8e2628 >2013-12-04 11:21:48,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 8e2628 >2013-12-04 11:21:48,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7b4b9234 >2013-12-04 11:21:48,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@837ed547, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaa66b3e}, log id: 7b4b9234 >2013-12-04 11:21:53,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5d5de650 >2013-12-04 11:21:53,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d5de650 >2013-12-04 11:21:53,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 301a0a4d >2013-12-04 11:21:54,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b40db681, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79bc0fa0}, log id: 301a0a4d >2013-12-04 11:21:59,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7caec72a >2013-12-04 11:21:59,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7caec72a >2013-12-04 11:21:59,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 114f45ea >2013-12-04 11:21:59,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b30a7539, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0ae7dad}, log id: 114f45ea >2013-12-04 11:22:05,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 42d027ba >2013-12-04 11:22:05,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 42d027ba >2013-12-04 11:22:05,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2003ad9a >2013-12-04 11:22:05,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16e4c23b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@158767f9}, log id: 2003ad9a >2013-12-04 11:22:10,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 80beb99 >2013-12-04 11:22:11,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 80beb99 >2013-12-04 11:22:11,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3595bf64 >2013-12-04 11:22:11,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acfd4729, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7b2f100}, log id: 3595bf64 >2013-12-04 11:22:16,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1adb74f0 >2013-12-04 11:22:17,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1adb74f0 >2013-12-04 11:22:17,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24766f6 >2013-12-04 11:22:17,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7d12f7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b237689}, log id: 24766f6 >2013-12-04 11:22:22,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 612f75a6 >2013-12-04 11:22:22,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 612f75a6 >2013-12-04 11:22:22,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4a1f5d68 >2013-12-04 11:22:23,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5429c462, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91d87af7}, log id: 4a1f5d68 >2013-12-04 11:22:26,346 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [54e92961] No up server in cluster >2013-12-04 11:22:26,347 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [54e92961] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:22:26,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7ff45421 >2013-12-04 11:22:26,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7ff45421 >2013-12-04 11:22:28,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 551b1cd1 >2013-12-04 11:22:28,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 551b1cd1 >2013-12-04 11:22:28,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 31bb5a36 >2013-12-04 11:22:29,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4abcc861, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b96897bb}, log id: 31bb5a36 >2013-12-04 11:22:34,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 173f2200 >2013-12-04 11:22:34,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 173f2200 >2013-12-04 11:22:34,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d82760 >2013-12-04 11:22:34,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5987a9d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f6f0455}, log id: 4d82760 >2013-12-04 11:22:39,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 50b4b8b1 >2013-12-04 11:22:40,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 50b4b8b1 >2013-12-04 11:22:40,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 38a1558 >2013-12-04 11:22:40,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61bda74b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61036290}, log id: 38a1558 >2013-12-04 11:22:45,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 20f59c9a >2013-12-04 11:22:46,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 20f59c9a >2013-12-04 11:22:46,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5fe8461a >2013-12-04 11:22:46,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcaf8219, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5947b7b9}, log id: 5fe8461a >2013-12-04 11:22:51,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 363a1598 >2013-12-04 11:22:52,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 363a1598 >2013-12-04 11:22:52,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 314ff75b >2013-12-04 11:22:52,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f58a8cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa52c716}, log id: 314ff75b >2013-12-04 11:22:57,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 109fa9d4 >2013-12-04 11:22:57,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 109fa9d4 >2013-12-04 11:22:57,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c14c5a >2013-12-04 11:22:58,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a1e28d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21d477b8}, log id: 4c14c5a >2013-12-04 11:23:03,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 431cedae >2013-12-04 11:23:03,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 431cedae >2013-12-04 11:23:03,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41f51f11 >2013-12-04 11:23:04,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41d56678, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff99351}, log id: 41f51f11 >2013-12-04 11:23:09,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 37905f88 >2013-12-04 11:23:09,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 37905f88 >2013-12-04 11:23:09,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4f8548f3 >2013-12-04 11:23:09,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8996c08b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aca355e8}, log id: 4f8548f3 >2013-12-04 11:23:14,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1fbd2294 >2013-12-04 11:23:15,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1fbd2294 >2013-12-04 11:23:15,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 270b5d7b >2013-12-04 11:23:15,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@386ec692, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d70c55a7}, log id: 270b5d7b >2013-12-04 11:23:20,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5c68a4e0 >2013-12-04 11:23:21,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c68a4e0 >2013-12-04 11:23:21,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2321d47f >2013-12-04 11:23:21,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbf3fdd1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89f4207e}, log id: 2321d47f >2013-12-04 11:23:26,656 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-04 11:23:26,656 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:23:26,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 33d116dc >2013-12-04 11:23:26,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4fd55eb0 >2013-12-04 11:23:26,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4fd55eb0 >2013-12-04 11:23:27,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 33d116dc >2013-12-04 11:23:27,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7d845305 >2013-12-04 11:23:27,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebc1854f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8d929ae}, log id: 7d845305 >2013-12-04 11:23:32,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2c6211ab >2013-12-04 11:23:33,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2c6211ab >2013-12-04 11:23:33,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a804ea4 >2013-12-04 11:23:33,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d700967f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95a23dd0}, log id: 3a804ea4 >2013-12-04 11:23:38,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: f77672a >2013-12-04 11:23:38,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: f77672a >2013-12-04 11:23:38,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29ed7b8d >2013-12-04 11:23:39,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e9ae163, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36761d82}, log id: 29ed7b8d >2013-12-04 11:23:44,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3452091b >2013-12-04 11:23:44,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3452091b >2013-12-04 11:23:44,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 51fb3a7f >2013-12-04 11:23:44,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99d8d3a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6b6bb}, log id: 51fb3a7f >2013-12-04 11:23:49,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3cef3e71 >2013-12-04 11:23:50,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3cef3e71 >2013-12-04 11:23:50,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 660f664c >2013-12-04 11:23:50,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fb5cbc4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f831425}, log id: 660f664c >2013-12-04 11:23:55,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b600bec >2013-12-04 11:23:56,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2b600bec >2013-12-04 11:23:56,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: f45178d >2013-12-04 11:23:56,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15be3de8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abf5aa70}, log id: f45178d >2013-12-04 11:24:01,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2317c941 >2013-12-04 11:24:02,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2317c941 >2013-12-04 11:24:02,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3edd7564 >2013-12-04 11:24:02,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a63122de, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17b31a32}, log id: 3edd7564 >2013-12-04 11:24:07,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7c6249fc >2013-12-04 11:24:07,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c6249fc >2013-12-04 11:24:07,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 44004551 >2013-12-04 11:24:08,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c22bae75, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30074bc7}, log id: 44004551 >2013-12-04 11:24:13,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6056dbf >2013-12-04 11:24:13,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6056dbf >2013-12-04 11:24:13,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38845c4f >2013-12-04 11:24:13,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6e306a5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a046a76}, log id: 38845c4f >2013-12-04 11:24:18,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4037034d >2013-12-04 11:24:19,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4037034d >2013-12-04 11:24:19,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 13ab3ae6 >2013-12-04 11:24:19,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2671bdd1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b049e98}, log id: 13ab3ae6 >2013-12-04 11:24:24,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 61a32084 >2013-12-04 11:24:25,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 61a32084 >2013-12-04 11:24:25,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a52f633 >2013-12-04 11:24:25,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffd4d24a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f06b7d4}, log id: 7a52f633 >2013-12-04 11:24:26,960 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) [75732b6e] No up server in cluster >2013-12-04 11:24:26,961 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) [75732b6e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:24:26,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: b920256 >2013-12-04 11:24:27,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterTasksListVDSCommand, return: [], log id: b920256 >2013-12-04 11:24:30,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 57a3b236 >2013-12-04 11:24:31,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 57a3b236 >2013-12-04 11:24:31,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2fa33d80 >2013-12-04 11:24:31,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@154fea29, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ddcb44a}, log id: 2fa33d80 >2013-12-04 11:24:36,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5c8f26f >2013-12-04 11:24:37,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c8f26f >2013-12-04 11:24:37,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 56826ec2 >2013-12-04 11:24:37,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4eb3e6c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff8e5ee9}, log id: 56826ec2 >2013-12-04 11:24:42,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 29c4f714 >2013-12-04 11:24:42,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 29c4f714 >2013-12-04 11:24:42,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 45de3a80 >2013-12-04 11:24:43,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1df662be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@606f63b0}, log id: 45de3a80 >2013-12-04 11:24:48,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: e85b15a >2013-12-04 11:24:48,710 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-48) [1f01d1f] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 11:24:48,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: e85b15a >2013-12-04 11:24:48,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2cdfe243 >2013-12-04 11:24:48,727 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-48) [1f01d1f] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 11:24:48,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf3de8a5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd009a87}, log id: 2cdfe243 >2013-12-04 11:24:49,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 239ec148 >2013-12-04 11:24:49,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@448acb15, log id: 239ec148 >2013-12-04 11:24:49,326 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-48) [1f01d1f] Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:24:49,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 741af2da >2013-12-04 11:24:49,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3f02c343, log id: 741af2da >2013-12-04 11:24:54,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a5b31c6 >2013-12-04 11:24:54,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6a5b31c6 >2013-12-04 11:24:54,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d181291 >2013-12-04 11:24:54,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77a52858, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a06da24}, log id: 7d181291 >2013-12-04 11:24:59,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7f35e3a1 >2013-12-04 11:25:00,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f35e3a1 >2013-12-04 11:25:00,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7afee68c >2013-12-04 11:25:00,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d07a091, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df27ad38}, log id: 7afee68c >2013-12-04 11:25:05,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2060b4ee >2013-12-04 11:25:06,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2060b4ee >2013-12-04 11:25:06,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f9f5ba7 >2013-12-04 11:25:06,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4acfbf6e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c9d35fc}, log id: 7f9f5ba7 >2013-12-04 11:25:11,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1da0531a >2013-12-04 11:25:12,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1da0531a >2013-12-04 11:25:12,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 44f1ddd >2013-12-04 11:25:12,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [7973d44b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4d4e75f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18017429}, log id: 44f1ddd >2013-12-04 11:25:17,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 533104fb >2013-12-04 11:25:17,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 533104fb >2013-12-04 11:25:17,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d9b3fb0 >2013-12-04 11:25:18,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e71ccf88, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6aded98}, log id: d9b3fb0 >2013-12-04 11:25:23,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 132513fb >2013-12-04 11:25:23,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 132513fb >2013-12-04 11:25:23,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a1574cf >2013-12-04 11:25:23,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f59a28ad, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6ba6009}, log id: 7a1574cf >2013-12-04 11:25:27,283 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-7) No up server in cluster >2013-12-04 11:25:27,283 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-7) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:25:27,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76115aa0 >2013-12-04 11:25:27,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, return: [], log id: 76115aa0 >2013-12-04 11:25:29,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 29c4f99 >2013-12-04 11:25:29,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 29c4f99 >2013-12-04 11:25:29,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 74b801f1 >2013-12-04 11:25:29,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34ba2d2f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ae23aa5}, log id: 74b801f1 >2013-12-04 11:25:34,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 52df4e58 >2013-12-04 11:25:35,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 52df4e58 >2013-12-04 11:25:35,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 49b07bbc >2013-12-04 11:25:35,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1dbc0ef4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93f5cf1c}, log id: 49b07bbc >2013-12-04 11:25:40,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 544b7d81 >2013-12-04 11:25:41,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 544b7d81 >2013-12-04 11:25:41,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d1f6a61 >2013-12-04 11:25:41,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9eda575d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1146a8d8}, log id: 3d1f6a61 >2013-12-04 11:25:46,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3437ef2a >2013-12-04 11:25:47,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3437ef2a >2013-12-04 11:25:47,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7862b843 >2013-12-04 11:25:47,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea988419, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@915ca740}, log id: 7862b843 >2013-12-04 11:25:52,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2318b3ad >2013-12-04 11:25:52,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2318b3ad >2013-12-04 11:25:52,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 48fbd49 >2013-12-04 11:25:53,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@765329e7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50c26ebb}, log id: 48fbd49 >2013-12-04 11:25:58,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47b6c45d >2013-12-04 11:25:58,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 47b6c45d >2013-12-04 11:25:58,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e5817a0 >2013-12-04 11:25:58,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9bc8757, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19a2e06d}, log id: 7e5817a0 >2013-12-04 11:26:03,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3947389b >2013-12-04 11:26:04,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3947389b >2013-12-04 11:26:04,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6ae9cf26 >2013-12-04 11:26:04,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18ffd3ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17f9bb72}, log id: 6ae9cf26 >2013-12-04 11:26:09,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 471dacc0 >2013-12-04 11:26:10,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 471dacc0 >2013-12-04 11:26:10,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 23405775 >2013-12-04 11:26:10,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d8be3d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90248984}, log id: 23405775 >2013-12-04 11:26:15,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7206a317 >2013-12-04 11:26:16,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7206a317 >2013-12-04 11:26:16,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3013788e >2013-12-04 11:26:16,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b437071, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3d4004f}, log id: 3013788e >2013-12-04 11:26:21,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6e833ce3 >2013-12-04 11:26:22,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6e833ce3 >2013-12-04 11:26:22,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7d3ca8fc >2013-12-04 11:26:22,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85a794d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85e7ac98}, log id: 7d3ca8fc >2013-12-04 11:26:27,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 640f60a9 >2013-12-04 11:26:27,583 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-04 11:26:27,583 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:26:27,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 13662304 >2013-12-04 11:26:27,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 640f60a9 >2013-12-04 11:26:27,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 189e0e63 >2013-12-04 11:26:27,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 13662304 >2013-12-04 11:26:28,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69a47286, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fabfffdc}, log id: 189e0e63 >2013-12-04 11:26:33,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: cb348ea >2013-12-04 11:26:33,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: cb348ea >2013-12-04 11:26:33,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3eb9f071 >2013-12-04 11:26:33,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee565b71, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7748ec3}, log id: 3eb9f071 >2013-12-04 11:26:39,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1386c069 >2013-12-04 11:26:39,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1386c069 >2013-12-04 11:26:39,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 71622ab5 >2013-12-04 11:26:39,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70bf0a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4749f9d0}, log id: 71622ab5 >2013-12-04 11:26:44,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4af84d8c >2013-12-04 11:26:45,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4af84d8c >2013-12-04 11:26:45,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5b5d9e60 >2013-12-04 11:26:45,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5011246, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2d899ad}, log id: 5b5d9e60 >2013-12-04 11:26:50,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19d2eb4a >2013-12-04 11:26:51,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 19d2eb4a >2013-12-04 11:26:51,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6f9c385 >2013-12-04 11:26:51,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c7c15d4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8137d57c}, log id: 6f9c385 >2013-12-04 11:26:56,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 289220d0 >2013-12-04 11:26:56,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 289220d0 >2013-12-04 11:26:56,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1629e76e >2013-12-04 11:26:57,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7f2db5d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5991e0f8}, log id: 1629e76e >2013-12-04 11:27:02,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 112f76a1 >2013-12-04 11:27:02,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 112f76a1 >2013-12-04 11:27:02,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1f1e33ef >2013-12-04 11:27:03,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@299d54da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d065822a}, log id: 1f1e33ef >2013-12-04 11:27:08,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 58a43ec0 >2013-12-04 11:27:08,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 58a43ec0 >2013-12-04 11:27:08,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 403623e9 >2013-12-04 11:27:08,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2974a82e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cf4aaf4}, log id: 403623e9 >2013-12-04 11:27:13,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7beee222 >2013-12-04 11:27:14,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7beee222 >2013-12-04 11:27:14,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5ecd5d79 >2013-12-04 11:27:14,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efc8b51d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f046145}, log id: 5ecd5d79 >2013-12-04 11:27:19,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20366c52 >2013-12-04 11:27:20,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 20366c52 >2013-12-04 11:27:20,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7cf0924e >2013-12-04 11:27:20,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a66ed4b5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ece4236}, log id: 7cf0924e >2013-12-04 11:27:25,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: f382a0b >2013-12-04 11:27:26,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: f382a0b >2013-12-04 11:27:26,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 27578eea >2013-12-04 11:27:26,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a6612d2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78881c7e}, log id: 27578eea >2013-12-04 11:27:27,892 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-04 11:27:27,892 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:27:27,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7c8a86ce >2013-12-04 11:27:28,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7c8a86ce >2013-12-04 11:27:31,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 356c4ca4 >2013-12-04 11:27:31,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 356c4ca4 >2013-12-04 11:27:31,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76463dbf >2013-12-04 11:27:32,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfdc078c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc6cf5d6}, log id: 76463dbf >2013-12-04 11:27:37,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2182222 >2013-12-04 11:27:37,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2182222 >2013-12-04 11:27:37,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 46b3432a >2013-12-04 11:27:37,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0430c93, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b510b23}, log id: 46b3432a >2013-12-04 11:27:43,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 541e56cb >2013-12-04 11:27:43,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 541e56cb >2013-12-04 11:27:43,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1bf66f6b >2013-12-04 11:27:43,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13fa741d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db5f4409}, log id: 1bf66f6b >2013-12-04 11:27:48,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2bee5b9c >2013-12-04 11:27:49,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2bee5b9c >2013-12-04 11:27:49,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1e2f81c3 >2013-12-04 11:27:49,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21431d8a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e7a3c3}, log id: 1e2f81c3 >2013-12-04 11:27:54,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3e0ed2e0 >2013-12-04 11:27:55,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e0ed2e0 >2013-12-04 11:27:55,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 65aed088 >2013-12-04 11:27:55,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a0013b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@605cdb4a}, log id: 65aed088 >2013-12-04 11:28:00,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1675f86f >2013-12-04 11:28:01,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1675f86f >2013-12-04 11:28:01,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4bbde19 >2013-12-04 11:28:01,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@625117be, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57ec132d}, log id: 4bbde19 >2013-12-04 11:28:06,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1dbe5908 >2013-12-04 11:28:06,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dbe5908 >2013-12-04 11:28:06,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 9bbc3a5 >2013-12-04 11:28:07,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1c6a7b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bb5f990}, log id: 9bbc3a5 >2013-12-04 11:28:12,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3bd40f8c >2013-12-04 11:28:12,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3bd40f8c >2013-12-04 11:28:12,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 528aeef2 >2013-12-04 11:28:12,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1f0d815, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a42e72c1}, log id: 528aeef2 >2013-12-04 11:28:17,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 51943035 >2013-12-04 11:28:18,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 51943035 >2013-12-04 11:28:18,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 52d48ac0 >2013-12-04 11:28:18,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@debda70f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68c70627}, log id: 52d48ac0 >2013-12-04 11:28:23,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59fb65d0 >2013-12-04 11:28:24,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 59fb65d0 >2013-12-04 11:28:24,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2025a717 >2013-12-04 11:28:24,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a23c130, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3f71c33}, log id: 2025a717 >2013-12-04 11:28:28,202 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-61) No up server in cluster >2013-12-04 11:28:28,202 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-61) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:28:28,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38b66cb5 >2013-12-04 11:28:28,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterTasksListVDSCommand, return: [], log id: 38b66cb5 >2013-12-04 11:28:29,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1031fa97 >2013-12-04 11:28:30,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1031fa97 >2013-12-04 11:28:30,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5bffb4c8 >2013-12-04 11:28:30,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f468f3b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c530296e}, log id: 5bffb4c8 >2013-12-04 11:28:35,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3e9972d0 >2013-12-04 11:28:35,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e9972d0 >2013-12-04 11:28:35,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 20f1b901 >2013-12-04 11:28:36,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c09f53ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f5ce6b7}, log id: 20f1b901 >2013-12-04 11:28:41,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 78bae760 >2013-12-04 11:28:41,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 78bae760 >2013-12-04 11:28:41,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 56564fe2 >2013-12-04 11:28:42,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@feb99b5c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b570f5}, log id: 56564fe2 >2013-12-04 11:28:47,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2fa192ce >2013-12-04 11:28:47,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2fa192ce >2013-12-04 11:28:47,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3326ebfd >2013-12-04 11:28:47,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df0aac89, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@704025a4}, log id: 3326ebfd >2013-12-04 11:28:52,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6f34a2c5 >2013-12-04 11:28:53,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6f34a2c5 >2013-12-04 11:28:53,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 74edc883 >2013-12-04 11:28:53,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4eaa8814, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b04fae8}, log id: 74edc883 >2013-12-04 11:28:58,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 58de2743 >2013-12-04 11:28:59,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 58de2743 >2013-12-04 11:28:59,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3f2cf024 >2013-12-04 11:28:59,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20d0751e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c0a05cf}, log id: 3f2cf024 >2013-12-04 11:29:04,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5fe9157a >2013-12-04 11:29:05,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5fe9157a >2013-12-04 11:29:05,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 16dcd5c4 >2013-12-04 11:29:05,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b020f6e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@286282e5}, log id: 16dcd5c4 >2013-12-04 11:29:10,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a70c457 >2013-12-04 11:29:10,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5a70c457 >2013-12-04 11:29:10,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 50f0312a >2013-12-04 11:29:11,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@389faa44, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d88336ca}, log id: 50f0312a >2013-12-04 11:29:16,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 63c41201 >2013-12-04 11:29:16,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 63c41201 >2013-12-04 11:29:16,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7e4bbff6 >2013-12-04 11:29:17,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1bcfb71, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa2d9978}, log id: 7e4bbff6 >2013-12-04 11:29:22,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a36c183 >2013-12-04 11:29:22,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3a36c183 >2013-12-04 11:29:22,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 70cb877b >2013-12-04 11:29:22,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46cf8aaa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2efa871c}, log id: 70cb877b >2013-12-04 11:29:27,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d2ed819 >2013-12-04 11:29:28,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5d2ed819 >2013-12-04 11:29:28,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2f852537 >2013-12-04 11:29:28,523 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) [1f2a7840] No up server in cluster >2013-12-04 11:29:28,524 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) [1f2a7840] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:29:28,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6b397ab0 >2013-12-04 11:29:28,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afc2ee3b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcf233e0}, log id: 2f852537 >2013-12-04 11:29:28,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1f2a7840] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6b397ab0 >2013-12-04 11:29:33,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3a710487 >2013-12-04 11:29:34,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3a710487 >2013-12-04 11:29:34,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7eba8b0b >2013-12-04 11:29:34,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a12cc070, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c3bacea}, log id: 7eba8b0b >2013-12-04 11:29:39,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 604b46af >2013-12-04 11:29:40,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 604b46af >2013-12-04 11:29:40,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 53b9010c >2013-12-04 11:29:40,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0a3e1b6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d8228b1}, log id: 53b9010c >2013-12-04 11:29:45,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7dbe800d >2013-12-04 11:29:45,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7dbe800d >2013-12-04 11:29:45,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 67cd0891 >2013-12-04 11:29:46,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98f3dcb3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9855b730}, log id: 67cd0891 >2013-12-04 11:29:49,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 716b99c9 >2013-12-04 11:29:50,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3d85f4ec, log id: 716b99c9 >2013-12-04 11:29:50,142 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-15) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:29:50,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2592d182 >2013-12-04 11:29:50,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5aacbc0f, log id: 2592d182 >2013-12-04 11:29:51,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7300ecbc >2013-12-04 11:29:51,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7300ecbc >2013-12-04 11:29:51,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6e207623 >2013-12-04 11:29:51,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4c699f2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ab8b0d5}, log id: 6e207623 >2013-12-04 11:29:56,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3b9a5293 >2013-12-04 11:29:57,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b9a5293 >2013-12-04 11:29:57,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1b585c97 >2013-12-04 11:29:57,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46a9804e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2f889ad}, log id: 1b585c97 >2013-12-04 11:30:02,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b107ec >2013-12-04 11:30:03,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: b107ec >2013-12-04 11:30:03,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 50212a4 >2013-12-04 11:30:03,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0e3060c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45e31086}, log id: 50212a4 >2013-12-04 11:30:08,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ceb019 >2013-12-04 11:30:09,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: ceb019 >2013-12-04 11:30:09,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2db84f17 >2013-12-04 11:30:09,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1df5f8d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7c65495}, log id: 2db84f17 >2013-12-04 11:30:14,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4332f90c >2013-12-04 11:30:14,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4332f90c >2013-12-04 11:30:14,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 38596c0e >2013-12-04 11:30:15,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfded131, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@778b092f}, log id: 38596c0e >2013-12-04 11:30:20,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 64e96ebb >2013-12-04 11:30:20,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 64e96ebb >2013-12-04 11:30:20,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b3d1c2a >2013-12-04 11:30:21,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a4325cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5e1b6e}, log id: 2b3d1c2a >2013-12-04 11:30:26,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5683e298 >2013-12-04 11:30:26,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5683e298 >2013-12-04 11:30:26,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 411a4e36 >2013-12-04 11:30:26,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0b7320a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@881ac3d5}, log id: 411a4e36 >2013-12-04 11:30:28,839 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-83) No up server in cluster >2013-12-04 11:30:28,839 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-83) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:30:28,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9024868 >2013-12-04 11:30:29,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterTasksListVDSCommand, return: [], log id: 9024868 >2013-12-04 11:30:31,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d468a84 >2013-12-04 11:30:32,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3d468a84 >2013-12-04 11:30:32,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 79e2d3e2 >2013-12-04 11:30:32,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5642a73e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e720451e}, log id: 79e2d3e2 >2013-12-04 11:30:37,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3bc08526 >2013-12-04 11:30:38,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3bc08526 >2013-12-04 11:30:38,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c7bac6d >2013-12-04 11:30:38,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@351552ac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18d449c7}, log id: 2c7bac6d >2013-12-04 11:30:43,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 72b62a6f >2013-12-04 11:30:44,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 72b62a6f >2013-12-04 11:30:44,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f1c79e1 >2013-12-04 11:30:44,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e38ea74, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfc37f27}, log id: 1f1c79e1 >2013-12-04 11:30:49,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 174b64dc >2013-12-04 11:30:49,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 174b64dc >2013-12-04 11:30:49,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 643d5fc8 >2013-12-04 11:30:50,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7102333d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fbaca2c}, log id: 643d5fc8 >2013-12-04 11:30:55,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d38260b >2013-12-04 11:30:55,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: d38260b >2013-12-04 11:30:55,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5a5b22ea >2013-12-04 11:30:55,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@804afda5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69109bc2}, log id: 5a5b22ea >2013-12-04 11:31:00,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5354c171 >2013-12-04 11:31:01,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5354c171 >2013-12-04 11:31:01,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c0672f4 >2013-12-04 11:31:01,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dde2c058, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cae98c17}, log id: 6c0672f4 >2013-12-04 11:31:06,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7221e7e >2013-12-04 11:31:07,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7221e7e >2013-12-04 11:31:07,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25463a15 >2013-12-04 11:31:07,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3883aff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0c5744b}, log id: 25463a15 >2013-12-04 11:31:12,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 28ce7bcd >2013-12-04 11:31:13,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 28ce7bcd >2013-12-04 11:31:13,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 248eb15 >2013-12-04 11:31:13,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7816a5b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a5d1617}, log id: 248eb15 >2013-12-04 11:31:18,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5959a7c8 >2013-12-04 11:31:18,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5959a7c8 >2013-12-04 11:31:18,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 324e2a56 >2013-12-04 11:31:19,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@473430f3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aad49afa}, log id: 324e2a56 >2013-12-04 11:31:24,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5159fee0 >2013-12-04 11:31:24,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5159fee0 >2013-12-04 11:31:24,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 228f04b7 >2013-12-04 11:31:25,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24892f66, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee21f878}, log id: 228f04b7 >2013-12-04 11:31:29,148 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) No up server in cluster >2013-12-04 11:31:29,148 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:31:29,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7c7127de >2013-12-04 11:31:29,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7c7127de >2013-12-04 11:31:30,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6b6534e7 >2013-12-04 11:31:30,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6b6534e7 >2013-12-04 11:31:30,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1fe84dda >2013-12-04 11:31:30,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8132ba1d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e7a99e2}, log id: 1fe84dda >2013-12-04 11:31:35,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 33f0914f >2013-12-04 11:31:36,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 33f0914f >2013-12-04 11:31:36,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 77f734f2 >2013-12-04 11:31:36,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@391a16ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f793c879}, log id: 77f734f2 >2013-12-04 11:31:41,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d85032f >2013-12-04 11:31:42,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6d85032f >2013-12-04 11:31:42,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3bc1c645 >2013-12-04 11:31:42,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6fcb392, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a1d21f3}, log id: 3bc1c645 >2013-12-04 11:31:47,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7342c343 >2013-12-04 11:31:48,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7342c343 >2013-12-04 11:31:48,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 398ce81a >2013-12-04 11:31:48,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dc7676d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@331558fb}, log id: 398ce81a >2013-12-04 11:31:53,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: e35d352 >2013-12-04 11:31:53,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: e35d352 >2013-12-04 11:31:53,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b5ae1f7 >2013-12-04 11:31:54,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b8e2128, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e77ff5a}, log id: 4b5ae1f7 >2013-12-04 11:31:59,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 28b29dd3 >2013-12-04 11:31:59,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 28b29dd3 >2013-12-04 11:31:59,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1eb89ba8 >2013-12-04 11:31:59,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d247f4c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e17ca659}, log id: 1eb89ba8 >2013-12-04 11:32:04,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29ad5851 >2013-12-04 11:32:05,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 29ad5851 >2013-12-04 11:32:05,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 37f2a2a5 >2013-12-04 11:32:05,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d72c47c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ee36912}, log id: 37f2a2a5 >2013-12-04 11:32:10,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7bebc451 >2013-12-04 11:32:11,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7bebc451 >2013-12-04 11:32:11,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 48028e8 >2013-12-04 11:32:11,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c85c9983, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab9c3efa}, log id: 48028e8 >2013-12-04 11:32:16,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 34e5efd8 >2013-12-04 11:32:17,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 34e5efd8 >2013-12-04 11:32:17,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2a504e08 >2013-12-04 11:32:17,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdf1fad7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9132cfb}, log id: 2a504e08 >2013-12-04 11:32:22,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 18aa06cd >2013-12-04 11:32:22,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 18aa06cd >2013-12-04 11:32:22,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4565bdae >2013-12-04 11:32:23,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccf8f6f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e001335}, log id: 4565bdae >2013-12-04 11:32:28,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e608878 >2013-12-04 11:32:28,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: e608878 >2013-12-04 11:32:28,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66e1e908 >2013-12-04 11:32:29,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ecd2ffff, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0c1a580}, log id: 66e1e908 >2013-12-04 11:32:29,451 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-04 11:32:29,452 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:32:29,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 44ea588a >2013-12-04 11:32:29,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 44ea588a >2013-12-04 11:32:34,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 68fe8e40 >2013-12-04 11:32:34,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 68fe8e40 >2013-12-04 11:32:34,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ebae314 >2013-12-04 11:32:34,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac4f4696, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50054b7f}, log id: ebae314 >2013-12-04 11:32:39,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70302085 >2013-12-04 11:32:40,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 70302085 >2013-12-04 11:32:40,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1212a31f >2013-12-04 11:32:40,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@343d9e10, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f34b1443}, log id: 1212a31f >2013-12-04 11:32:45,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12fb81a5 >2013-12-04 11:32:46,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 12fb81a5 >2013-12-04 11:32:46,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4a49d306 >2013-12-04 11:32:46,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7a26fb5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53cf48bb}, log id: 4a49d306 >2013-12-04 11:32:51,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10ee980f >2013-12-04 11:32:52,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 10ee980f >2013-12-04 11:32:52,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 79402953 >2013-12-04 11:32:52,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b1305bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53410ff6}, log id: 79402953 >2013-12-04 11:32:57,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7fc1dff4 >2013-12-04 11:32:57,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7fc1dff4 >2013-12-04 11:32:57,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7426fa05 >2013-12-04 11:32:58,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8e005a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46c63179}, log id: 7426fa05 >2013-12-04 11:33:03,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2edbca82 >2013-12-04 11:33:04,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2edbca82 >2013-12-04 11:33:04,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 741b57fc >2013-12-04 11:33:04,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3089cef0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27658eb}, log id: 741b57fc >2013-12-04 11:33:09,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4e7edda4 >2013-12-04 11:33:09,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e7edda4 >2013-12-04 11:33:09,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7755d4ed >2013-12-04 11:33:10,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f98508f3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6110ed52}, log id: 7755d4ed >2013-12-04 11:33:15,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 151616fb >2013-12-04 11:33:15,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 151616fb >2013-12-04 11:33:15,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67510bb3 >2013-12-04 11:33:15,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d099cba, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae09517c}, log id: 67510bb3 >2013-12-04 11:33:21,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6ed6ed50 >2013-12-04 11:33:21,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6ed6ed50 >2013-12-04 11:33:21,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 31a71bb1 >2013-12-04 11:33:21,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@133b20bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92ba978c}, log id: 31a71bb1 >2013-12-04 11:33:26,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1572e465 >2013-12-04 11:33:27,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1572e465 >2013-12-04 11:33:27,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 151a378d >2013-12-04 11:33:27,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@115e68ce, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94708038}, log id: 151a378d >2013-12-04 11:33:29,766 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) No up server in cluster >2013-12-04 11:33:29,767 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:33:29,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69c5c1d9 >2013-12-04 11:33:30,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterTasksListVDSCommand, return: [], log id: 69c5c1d9 >2013-12-04 11:33:32,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: bfcc858 >2013-12-04 11:33:33,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: bfcc858 >2013-12-04 11:33:33,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2c1d3476 >2013-12-04 11:33:33,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cef2061, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc058da5}, log id: 2c1d3476 >2013-12-04 11:33:38,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c0416f6 >2013-12-04 11:33:39,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6c0416f6 >2013-12-04 11:33:39,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: f900292 >2013-12-04 11:33:39,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7adf71ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef458794}, log id: f900292 >2013-12-04 11:33:44,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6c97c9da >2013-12-04 11:33:44,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c97c9da >2013-12-04 11:33:44,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 27816da0 >2013-12-04 11:33:45,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45349932, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a1b30dc}, log id: 27816da0 >2013-12-04 11:33:50,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 38d19ebe >2013-12-04 11:33:50,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 38d19ebe >2013-12-04 11:33:50,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 67d71e1e >2013-12-04 11:33:51,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4776da73, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10f45009}, log id: 67d71e1e >2013-12-04 11:33:56,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5706732e >2013-12-04 11:33:56,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5706732e >2013-12-04 11:33:56,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 11fb026d >2013-12-04 11:33:56,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61e61dbd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb468a14}, log id: 11fb026d >2013-12-04 11:34:01,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3209a120 >2013-12-04 11:34:02,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3209a120 >2013-12-04 11:34:02,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6d076526 >2013-12-04 11:34:02,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55b7c1bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae269adb}, log id: 6d076526 >2013-12-04 11:34:07,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: d8a88a0 >2013-12-04 11:34:08,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: d8a88a0 >2013-12-04 11:34:08,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6b886f77 >2013-12-04 11:34:08,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d97f4ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60a2cbd}, log id: 6b886f77 >2013-12-04 11:34:13,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: df71ea3 >2013-12-04 11:34:13,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: df71ea3 >2013-12-04 11:34:13,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 242b808c >2013-12-04 11:34:14,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfec3a6c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8007c698}, log id: 242b808c >2013-12-04 11:34:19,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3466f7f9 >2013-12-04 11:34:19,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3466f7f9 >2013-12-04 11:34:19,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 40503750 >2013-12-04 11:34:20,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63d6f49, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b426f9ba}, log id: 40503750 >2013-12-04 11:34:25,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 30355801 >2013-12-04 11:34:25,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 30355801 >2013-12-04 11:34:25,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4826a63d >2013-12-04 11:34:25,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85d89131, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9224d21}, log id: 4826a63d >2013-12-04 11:34:30,085 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) [73a35da9] No up server in cluster >2013-12-04 11:34:30,086 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) [73a35da9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:34:30,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 42974765 >2013-12-04 11:34:30,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterTasksListVDSCommand, return: [], log id: 42974765 >2013-12-04 11:34:30,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5e4a4553 >2013-12-04 11:34:31,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5e4a4553 >2013-12-04 11:34:31,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6e43a1ed >2013-12-04 11:34:31,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40f05454, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@389cd4fc}, log id: 6e43a1ed >2013-12-04 11:34:36,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5d7cc8cd >2013-12-04 11:34:37,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5d7cc8cd >2013-12-04 11:34:37,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 787228a1 >2013-12-04 11:34:37,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ce592e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c9dc73}, log id: 787228a1 >2013-12-04 11:34:42,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: d470388 >2013-12-04 11:34:43,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: d470388 >2013-12-04 11:34:43,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6553d832 >2013-12-04 11:34:43,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ddd46ca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@779d4a1b}, log id: 6553d832 >2013-12-04 11:34:48,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25676dee >2013-12-04 11:34:48,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 25676dee >2013-12-04 11:34:48,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 30ccfb22 >2013-12-04 11:34:49,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d24f38d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14597cc6}, log id: 30ccfb22 >2013-12-04 11:34:50,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a1297a8 >2013-12-04 11:34:50,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4b7fe331, log id: 7a1297a8 >2013-12-04 11:34:50,728 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-6) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:34:50,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 391cccb0 >2013-12-04 11:34:51,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@43b26a27, log id: 391cccb0 >2013-12-04 11:34:54,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7b2598e7 >2013-12-04 11:34:54,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b2598e7 >2013-12-04 11:34:54,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 31f5d74b >2013-12-04 11:34:55,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cdf4d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12f14b42}, log id: 31f5d74b >2013-12-04 11:35:00,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 228c4e50 >2013-12-04 11:35:00,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 228c4e50 >2013-12-04 11:35:00,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1a4c32c2 >2013-12-04 11:35:00,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb49d2c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8dace15}, log id: 1a4c32c2 >2013-12-04 11:35:05,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78e6c11f >2013-12-04 11:35:06,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 78e6c11f >2013-12-04 11:35:06,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4c745ceb >2013-12-04 11:35:06,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@702f97ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc556b60}, log id: 4c745ceb >2013-12-04 11:35:11,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 458a98be >2013-12-04 11:35:12,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 458a98be >2013-12-04 11:35:12,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66ac3399 >2013-12-04 11:35:12,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce630154, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e12fabf}, log id: 66ac3399 >2013-12-04 11:35:17,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54249f17 >2013-12-04 11:35:18,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 54249f17 >2013-12-04 11:35:18,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4bb1fa76 >2013-12-04 11:35:18,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2b96f4d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5211d994}, log id: 4bb1fa76 >2013-12-04 11:35:23,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4eaa85a5 >2013-12-04 11:35:23,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4eaa85a5 >2013-12-04 11:35:23,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 395871a0 >2013-12-04 11:35:24,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8487dd0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59f21a38}, log id: 395871a0 >2013-12-04 11:35:29,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1032473d >2013-12-04 11:35:29,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1032473d >2013-12-04 11:35:29,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 187c124 >2013-12-04 11:35:29,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5adb9513, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef6f0a4f}, log id: 187c124 >2013-12-04 11:35:30,398 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) No up server in cluster >2013-12-04 11:35:30,398 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:35:30,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 36bf0272 >2013-12-04 11:35:30,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, return: [], log id: 36bf0272 >2013-12-04 11:35:35,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 218f5fd9 >2013-12-04 11:35:35,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 218f5fd9 >2013-12-04 11:35:35,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7b66c92c >2013-12-04 11:35:35,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6794d59a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c10096d}, log id: 7b66c92c >2013-12-04 11:35:40,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 385e048d >2013-12-04 11:35:41,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 385e048d >2013-12-04 11:35:41,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 56d60fc9 >2013-12-04 11:35:41,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64db7db1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a7db75d}, log id: 56d60fc9 >2013-12-04 11:35:46,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 628b66b >2013-12-04 11:35:47,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 628b66b >2013-12-04 11:35:47,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a606c49 >2013-12-04 11:35:47,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99325c35, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7335f8f9}, log id: 7a606c49 >2013-12-04 11:35:52,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 209ddf2f >2013-12-04 11:35:53,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 209ddf2f >2013-12-04 11:35:53,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 85c871f >2013-12-04 11:35:53,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8a9613b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e2b4a7c}, log id: 85c871f >2013-12-04 11:35:58,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 239dcdcb >2013-12-04 11:35:58,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 239dcdcb >2013-12-04 11:35:58,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 54df18cd >2013-12-04 11:35:59,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f818df13, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5b81d95}, log id: 54df18cd >2013-12-04 11:36:04,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 70793c90 >2013-12-04 11:36:04,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 70793c90 >2013-12-04 11:36:04,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 175d1110 >2013-12-04 11:36:04,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2de5d3a7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94237258}, log id: 175d1110 >2013-12-04 11:36:09,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 75809f6a >2013-12-04 11:36:10,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 75809f6a >2013-12-04 11:36:10,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e022302 >2013-12-04 11:36:10,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@193b08c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52c706c7}, log id: 1e022302 >2013-12-04 11:36:15,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 312b8979 >2013-12-04 11:36:16,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 312b8979 >2013-12-04 11:36:16,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 51318356 >2013-12-04 11:36:16,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83fb9ee3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e93579c}, log id: 51318356 >2013-12-04 11:36:21,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3bbe6c18 >2013-12-04 11:36:22,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3bbe6c18 >2013-12-04 11:36:22,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a05e5b9 >2013-12-04 11:36:22,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cbbef33, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@592589c9}, log id: 5a05e5b9 >2013-12-04 11:36:27,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6be8fc2a >2013-12-04 11:36:27,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6be8fc2a >2013-12-04 11:36:27,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4348ef9 >2013-12-04 11:36:28,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5237554, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@162db26e}, log id: 4348ef9 >2013-12-04 11:36:30,705 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-04 11:36:30,706 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:36:30,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b495dae >2013-12-04 11:36:31,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2b495dae >2013-12-04 11:36:33,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d1ca23b >2013-12-04 11:36:33,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4d1ca23b >2013-12-04 11:36:33,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6afb7b7 >2013-12-04 11:36:34,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24c05e96, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d93e8205}, log id: 6afb7b7 >2013-12-04 11:36:39,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2aea56cf >2013-12-04 11:36:39,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2aea56cf >2013-12-04 11:36:39,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: bc75d20 >2013-12-04 11:36:39,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc95c068, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea599961}, log id: bc75d20 >2013-12-04 11:36:44,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4af981e7 >2013-12-04 11:36:45,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4af981e7 >2013-12-04 11:36:45,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 557c4d52 >2013-12-04 11:36:45,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8383892c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37873d70}, log id: 557c4d52 >2013-12-04 11:36:50,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 20eaa483 >2013-12-04 11:36:51,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 20eaa483 >2013-12-04 11:36:51,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 627d326b >2013-12-04 11:36:51,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce0a4941, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddd8e6b1}, log id: 627d326b >2013-12-04 11:36:56,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 12e70114 >2013-12-04 11:36:56,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 12e70114 >2013-12-04 11:36:56,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4cce3ea3 >2013-12-04 11:36:57,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2358079, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fabaf3c6}, log id: 4cce3ea3 >2013-12-04 11:37:02,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 518b925b >2013-12-04 11:37:02,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 518b925b >2013-12-04 11:37:02,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 775309b5 >2013-12-04 11:37:03,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79b33338, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11745c04}, log id: 775309b5 >2013-12-04 11:37:08,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 35446703 >2013-12-04 11:37:08,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 35446703 >2013-12-04 11:37:08,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7f431fe5 >2013-12-04 11:37:09,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efcef220, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2675bfe1}, log id: 7f431fe5 >2013-12-04 11:37:14,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25aae574 >2013-12-04 11:37:14,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 25aae574 >2013-12-04 11:37:14,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7dd94457 >2013-12-04 11:37:14,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e012e600, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74118240}, log id: 7dd94457 >2013-12-04 11:37:20,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 68c9344f >2013-12-04 11:37:20,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 68c9344f >2013-12-04 11:37:20,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 13b9679a >2013-12-04 11:37:20,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b4359bc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@128415e4}, log id: 13b9679a >2013-12-04 11:37:25,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 51ff3a1a >2013-12-04 11:37:26,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 51ff3a1a >2013-12-04 11:37:26,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7adb2c3e >2013-12-04 11:37:26,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83bb9d36, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@990832c1}, log id: 7adb2c3e >2013-12-04 11:37:31,040 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-04 11:37:31,048 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:37:31,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 689398f6 >2013-12-04 11:37:31,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: 689398f6 >2013-12-04 11:37:31,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2a52e0a1 >2013-12-04 11:37:32,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2a52e0a1 >2013-12-04 11:37:32,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45747498 >2013-12-04 11:37:32,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd1eccee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70541ed0}, log id: 45747498 >2013-12-04 11:37:37,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 400c7b60 >2013-12-04 11:37:38,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 400c7b60 >2013-12-04 11:37:38,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6293f2be >2013-12-04 11:37:38,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9802ecf9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ccc5bf0}, log id: 6293f2be >2013-12-04 11:37:43,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1c2edd4a >2013-12-04 11:37:43,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1c2edd4a >2013-12-04 11:37:43,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 17946830 >2013-12-04 11:37:44,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71805fc3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34da3256}, log id: 17946830 >2013-12-04 11:37:49,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 871123c >2013-12-04 11:37:49,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 871123c >2013-12-04 11:37:49,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32bdc2a2 >2013-12-04 11:37:49,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80b5b75a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@594296f3}, log id: 32bdc2a2 >2013-12-04 11:37:54,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4e23290e >2013-12-04 11:37:55,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4e23290e >2013-12-04 11:37:55,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 686dea19 >2013-12-04 11:37:55,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@351a5eae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4a0bb09}, log id: 686dea19 >2013-12-04 11:38:00,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5d4f791b >2013-12-04 11:38:01,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5d4f791b >2013-12-04 11:38:01,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 23dc778f >2013-12-04 11:38:01,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ac7b9d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d71aebcf}, log id: 23dc778f >2013-12-04 11:38:06,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2f59e118 >2013-12-04 11:38:07,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f59e118 >2013-12-04 11:38:07,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 28eac203 >2013-12-04 11:38:07,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdba58d4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@702748e}, log id: 28eac203 >2013-12-04 11:38:12,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 56ff9e7e >2013-12-04 11:38:12,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 56ff9e7e >2013-12-04 11:38:12,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6dd4e0ae >2013-12-04 11:38:13,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@707e0d53, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9eea665d}, log id: 6dd4e0ae >2013-12-04 11:38:18,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2196b1e9 >2013-12-04 11:38:18,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2196b1e9 >2013-12-04 11:38:18,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40d9df31 >2013-12-04 11:38:19,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8467f462, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7a478c}, log id: 40d9df31 >2013-12-04 11:38:24,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 619835b7 >2013-12-04 11:38:24,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 619835b7 >2013-12-04 11:38:24,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 774acf2b >2013-12-04 11:38:24,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@291b910f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbf10270}, log id: 774acf2b >2013-12-04 11:38:29,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 365d1f89 >2013-12-04 11:38:30,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 365d1f89 >2013-12-04 11:38:30,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1f14afc8 >2013-12-04 11:38:30,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d491b478, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd1b0c1e}, log id: 1f14afc8 >2013-12-04 11:38:31,443 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-04 11:38:31,454 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:38:31,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 705895f1 >2013-12-04 11:38:31,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 705895f1 >2013-12-04 11:38:35,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 29b0dc8d >2013-12-04 11:38:36,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 29b0dc8d >2013-12-04 11:38:36,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32f76817 >2013-12-04 11:38:36,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4349551, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae083363}, log id: 32f76817 >2013-12-04 11:38:36,926 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VMs/Templates Ovf. >2013-12-04 11:38:37,091 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-88) [6463bdcc] Start refreshing all users data >2013-12-04 11:38:41,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b5b4caa >2013-12-04 11:38:42,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4b5b4caa >2013-12-04 11:38:42,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 994fec8 >2013-12-04 11:38:42,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@486e41ac, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d8390e8}, log id: 994fec8 >2013-12-04 11:38:47,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 43a17856 >2013-12-04 11:38:47,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 43a17856 >2013-12-04 11:38:47,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 72741bfb >2013-12-04 11:38:48,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca7f1215, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfd0727a}, log id: 72741bfb >2013-12-04 11:38:53,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 45a30c49 >2013-12-04 11:38:53,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 45a30c49 >2013-12-04 11:38:53,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f8e779c >2013-12-04 11:38:53,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2ba76f5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b56b0c6a}, log id: 3f8e779c >2013-12-04 11:38:58,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 159de16 >2013-12-04 11:38:59,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 159de16 >2013-12-04 11:38:59,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b7fda7a >2013-12-04 11:38:59,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60607a32, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d5635f1}, log id: 2b7fda7a >2013-12-04 11:39:04,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 40f6cde9 >2013-12-04 11:39:05,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 40f6cde9 >2013-12-04 11:39:05,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3cded2d1 >2013-12-04 11:39:05,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afce4f9c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cf048ee}, log id: 3cded2d1 >2013-12-04 11:39:10,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a4be58b >2013-12-04 11:39:11,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: a4be58b >2013-12-04 11:39:11,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6cea713 >2013-12-04 11:39:11,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [e67de57] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50316e5a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d786f47a}, log id: 6cea713 >2013-12-04 11:39:16,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 10d5391f >2013-12-04 11:39:17,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 10d5391f >2013-12-04 11:39:17,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 17442ab1 >2013-12-04 11:39:17,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcaaa4a0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@859de778}, log id: 17442ab1 >2013-12-04 11:39:22,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 650af34 >2013-12-04 11:39:22,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 650af34 >2013-12-04 11:39:22,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 179f5b13 >2013-12-04 11:39:23,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd85ab3c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4a8b58a}, log id: 179f5b13 >2013-12-04 11:39:28,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1daed986 >2013-12-04 11:39:28,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1daed986 >2013-12-04 11:39:28,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4c8057a4 >2013-12-04 11:39:29,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d10d365, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d07c0a51}, log id: 4c8057a4 >2013-12-04 11:39:31,777 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-83) No up server in cluster >2013-12-04 11:39:31,778 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-83) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:39:31,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5a43c0af >2013-12-04 11:39:32,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5a43c0af >2013-12-04 11:39:34,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2c2ef11e >2013-12-04 11:39:34,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2c2ef11e >2013-12-04 11:39:34,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 13c0b84d >2013-12-04 11:39:34,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c416840, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87fb04c1}, log id: 13c0b84d >2013-12-04 11:39:39,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 38ed4a4a >2013-12-04 11:39:40,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 38ed4a4a >2013-12-04 11:39:40,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e210175 >2013-12-04 11:39:40,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cde6f3e4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@514c9471}, log id: 7e210175 >2013-12-04 11:39:45,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3aeed05 >2013-12-04 11:39:46,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3aeed05 >2013-12-04 11:39:46,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 40a89170 >2013-12-04 11:39:46,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@280c7b22, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a638f0}, log id: 40a89170 >2013-12-04 11:39:51,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5151543d >2013-12-04 11:39:51,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6d842c71, log id: 5151543d >2013-12-04 11:39:51,338 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-72) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:39:51,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 81e6e3 >2013-12-04 11:39:51,520 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-12) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-04 11:39:51,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6e1c09cb, log id: 81e6e3 >2013-12-04 11:39:51,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 72c726e6 >2013-12-04 11:39:52,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 72c726e6 >2013-12-04 11:39:52,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5f7d2c05 >2013-12-04 11:39:52,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@422c14d3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abc381d7}, log id: 5f7d2c05 >2013-12-04 11:39:57,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: f514a5f >2013-12-04 11:39:57,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: f514a5f >2013-12-04 11:39:57,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7345bc49 >2013-12-04 11:39:58,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fb1b6a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6964a81}, log id: 7345bc49 >2013-12-04 11:40:03,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 453ac447 >2013-12-04 11:40:03,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 453ac447 >2013-12-04 11:40:03,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5969df2c >2013-12-04 11:40:04,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d609bfb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a18780a5}, log id: 5969df2c >2013-12-04 11:40:09,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 14be1f8 >2013-12-04 11:40:09,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 14be1f8 >2013-12-04 11:40:09,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27fc0c6c >2013-12-04 11:40:09,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c524cb44, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63075cf2}, log id: 27fc0c6c >2013-12-04 11:40:15,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1cd21848 >2013-12-04 11:40:15,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cd21848 >2013-12-04 11:40:15,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 12019dcf >2013-12-04 11:40:15,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac49e119, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d8d13d6}, log id: 12019dcf >2013-12-04 11:40:20,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4a4e1e70 >2013-12-04 11:40:21,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4a4e1e70 >2013-12-04 11:40:21,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2d51e3ea >2013-12-04 11:40:21,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59f618b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc16cb58}, log id: 2d51e3ea >2013-12-04 11:40:26,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 635a2c21 >2013-12-04 11:40:27,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 635a2c21 >2013-12-04 11:40:27,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 36837105 >2013-12-04 11:40:27,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2766a666, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4497c2f6}, log id: 36837105 >2013-12-04 11:40:32,136 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-43) No up server in cluster >2013-12-04 11:40:32,137 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-43) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:40:32,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 738953ee >2013-12-04 11:40:32,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterTasksListVDSCommand, return: [], log id: 738953ee >2013-12-04 11:40:32,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 39678fc8 >2013-12-04 11:40:32,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 39678fc8 >2013-12-04 11:40:32,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 13185dc2 >2013-12-04 11:40:33,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) [6dd5dead] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a65decb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1bfb871}, log id: 13185dc2 >2013-12-04 11:40:38,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1cc6e9e8 >2013-12-04 11:40:38,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cc6e9e8 >2013-12-04 11:40:38,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7583f889 >2013-12-04 11:40:39,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19c51069, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1946b46b}, log id: 7583f889 >2013-12-04 11:40:44,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2496a49d >2013-12-04 11:40:44,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2496a49d >2013-12-04 11:40:44,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2fe6dee2 >2013-12-04 11:40:44,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a8f0846, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0865659}, log id: 2fe6dee2 >2013-12-04 11:40:49,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e5d08c7 >2013-12-04 11:40:50,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3e5d08c7 >2013-12-04 11:40:50,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2830526 >2013-12-04 11:40:50,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55145f26, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4546e74}, log id: 2830526 >2013-12-04 11:40:55,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1612dca2 >2013-12-04 11:40:56,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1612dca2 >2013-12-04 11:40:56,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a727719 >2013-12-04 11:40:56,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f63f8704, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ff2f44b}, log id: 7a727719 >2013-12-04 11:41:01,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 341d4d77 >2013-12-04 11:41:02,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 341d4d77 >2013-12-04 11:41:02,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7ffab85a >2013-12-04 11:41:02,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c9708a2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bc7ece7}, log id: 7ffab85a >2013-12-04 11:41:07,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1e5a24f0 >2013-12-04 11:41:07,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1e5a24f0 >2013-12-04 11:41:07,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 56125267 >2013-12-04 11:41:08,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dc6e312, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4b11f89}, log id: 56125267 >2013-12-04 11:41:13,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 663c58b6 >2013-12-04 11:41:13,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 663c58b6 >2013-12-04 11:41:13,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: ce434ce >2013-12-04 11:41:14,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b23a32c1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70b77693}, log id: ce434ce >2013-12-04 11:41:19,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 35561956 >2013-12-04 11:41:19,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 35561956 >2013-12-04 11:41:19,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4ebe81df >2013-12-04 11:41:19,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f935fb9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59efac6a}, log id: 4ebe81df >2013-12-04 11:41:24,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 678bcdf >2013-12-04 11:41:25,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 678bcdf >2013-12-04 11:41:25,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 17ecaeb8 >2013-12-04 11:41:25,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a08543d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d23c10f}, log id: 17ecaeb8 >2013-12-04 11:41:30,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f1fd01f >2013-12-04 11:41:31,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7f1fd01f >2013-12-04 11:41:31,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2ab46524 >2013-12-04 11:41:31,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2da87f68, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fc25459}, log id: 2ab46524 >2013-12-04 11:41:32,457 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-04 11:41:32,458 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:41:32,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 33d712ca >2013-12-04 11:41:32,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 33d712ca >2013-12-04 11:41:36,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2344b0e2 >2013-12-04 11:41:37,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2344b0e2 >2013-12-04 11:41:37,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 421119a5 >2013-12-04 11:41:37,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ea5fb9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8849cfe}, log id: 421119a5 >2013-12-04 11:41:42,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2aa9fa02 >2013-12-04 11:41:42,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2aa9fa02 >2013-12-04 11:41:42,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6622f50 >2013-12-04 11:41:43,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fb6cd5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b63d69d0}, log id: 6622f50 >2013-12-04 11:41:48,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1696424b >2013-12-04 11:41:48,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1696424b >2013-12-04 11:41:48,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6636a2e >2013-12-04 11:41:49,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bff8703, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b8114c8}, log id: 6636a2e >2013-12-04 11:41:54,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 50294092 >2013-12-04 11:41:54,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 50294092 >2013-12-04 11:41:54,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 774a81a0 >2013-12-04 11:41:54,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [6463bdcc] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f5813fa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f90f7fa}, log id: 774a81a0 >2013-12-04 11:41:59,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5fe1c1d3 >2013-12-04 11:42:00,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5fe1c1d3 >2013-12-04 11:42:00,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5802439e >2013-12-04 11:42:00,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb0b8df0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73c7506d}, log id: 5802439e >2013-12-04 11:42:05,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4376dafb >2013-12-04 11:42:06,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4376dafb >2013-12-04 11:42:06,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e2ee27b >2013-12-04 11:42:06,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@277073a1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@703ac766}, log id: 7e2ee27b >2013-12-04 11:42:11,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 21b3c213 >2013-12-04 11:42:12,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 21b3c213 >2013-12-04 11:42:12,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12cc9955 >2013-12-04 11:42:12,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3e3f48e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7acbe919}, log id: 12cc9955 >2013-12-04 11:42:17,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42965a11 >2013-12-04 11:42:17,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 42965a11 >2013-12-04 11:42:17,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 25399bea >2013-12-04 11:42:18,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2ccd498, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a34c6e46}, log id: 25399bea >2013-12-04 11:42:23,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 46fe01dd >2013-12-04 11:42:23,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 46fe01dd >2013-12-04 11:42:23,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b3f8d4b >2013-12-04 11:42:23,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67df3c0c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10d2a416}, log id: 2b3f8d4b >2013-12-04 11:42:29,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 79c03630 >2013-12-04 11:42:29,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 79c03630 >2013-12-04 11:42:29,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4065368e >2013-12-04 11:42:29,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ede0ff94, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33a908bd}, log id: 4065368e >2013-12-04 11:42:32,765 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) No up server in cluster >2013-12-04 11:42:32,765 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:42:32,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 46928f1b >2013-12-04 11:42:33,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterTasksListVDSCommand, return: [], log id: 46928f1b >2013-12-04 11:42:34,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6eba33bf >2013-12-04 11:42:35,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6eba33bf >2013-12-04 11:42:35,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2a8b667 >2013-12-04 11:42:35,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [75732b6e] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5bbc1ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46e5853d}, log id: 2a8b667 >2013-12-04 11:42:40,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 11b254c6 >2013-12-04 11:42:41,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 11b254c6 >2013-12-04 11:42:41,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36d4ff8 >2013-12-04 11:42:41,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3bd0b40, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1368b7b}, log id: 36d4ff8 >2013-12-04 11:42:46,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 60ecbcd3 >2013-12-04 11:42:46,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 60ecbcd3 >2013-12-04 11:42:47,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 33b0e6cc >2013-12-04 11:42:47,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b248f734, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7b720f}, log id: 33b0e6cc >2013-12-04 11:42:52,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2606c0b >2013-12-04 11:42:52,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2606c0b >2013-12-04 11:42:52,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41487f8f >2013-12-04 11:42:53,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bdc2990, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56ebcf4f}, log id: 41487f8f >2013-12-04 11:42:58,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7fcfdadd >2013-12-04 11:42:58,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7fcfdadd >2013-12-04 11:42:58,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5277c7f0 >2013-12-04 11:42:58,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8f22433, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4161fe51}, log id: 5277c7f0 >2013-12-04 11:43:03,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 517c4b51 >2013-12-04 11:43:04,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 517c4b51 >2013-12-04 11:43:04,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 25cf4337 >2013-12-04 11:43:04,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8e0bdc3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ec82dea}, log id: 25cf4337 >2013-12-04 11:43:09,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 131de3e8 >2013-12-04 11:43:10,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 131de3e8 >2013-12-04 11:43:10,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e82a9e3 >2013-12-04 11:43:10,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3304fbe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b141bb}, log id: 7e82a9e3 >2013-12-04 11:43:15,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d73a7d4 >2013-12-04 11:43:16,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7d73a7d4 >2013-12-04 11:43:16,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5614af13 >2013-12-04 11:43:16,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fbab101, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b4179d5}, log id: 5614af13 >2013-12-04 11:43:21,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5dfec139 >2013-12-04 11:43:21,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5dfec139 >2013-12-04 11:43:21,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 72a6c119 >2013-12-04 11:43:22,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48673d52, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@413c2585}, log id: 72a6c119 >2013-12-04 11:43:27,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2214e2b >2013-12-04 11:43:27,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2214e2b >2013-12-04 11:43:27,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5027f6b3 >2013-12-04 11:43:28,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe3a51f7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aed5d35d}, log id: 5027f6b3 >2013-12-04 11:43:33,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63775342 >2013-12-04 11:43:33,102 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) No up server in cluster >2013-12-04 11:43:33,102 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:43:33,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 24c3c9f5 >2013-12-04 11:43:33,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, return: [], log id: 24c3c9f5 >2013-12-04 11:43:33,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 63775342 >2013-12-04 11:43:33,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29985dd8 >2013-12-04 11:43:33,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [451f957d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65c458ec, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@919a40be}, log id: 29985dd8 >2013-12-04 11:43:38,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37af99c >2013-12-04 11:43:39,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 37af99c >2013-12-04 11:43:39,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2678c24b >2013-12-04 11:43:39,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8450ac1a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d453b551}, log id: 2678c24b >2013-12-04 11:43:44,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3764a3c6 >2013-12-04 11:43:45,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3764a3c6 >2013-12-04 11:43:45,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 311f20a9 >2013-12-04 11:43:45,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f50963e3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7595fb07}, log id: 311f20a9 >2013-12-04 11:43:50,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ad46714 >2013-12-04 11:43:50,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: ad46714 >2013-12-04 11:43:50,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d902360 >2013-12-04 11:43:51,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0b90365, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40b3dfc}, log id: 4d902360 >2013-12-04 11:43:56,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 121ce7d1 >2013-12-04 11:43:56,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 121ce7d1 >2013-12-04 11:43:56,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d76f4b5 >2013-12-04 11:43:57,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8c1993f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5847086}, log id: d76f4b5 >2013-12-04 11:44:02,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 61f9682d >2013-12-04 11:44:02,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 61f9682d >2013-12-04 11:44:02,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7123bff8 >2013-12-04 11:44:02,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b29941f3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff740fcb}, log id: 7123bff8 >2013-12-04 11:44:07,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 49460c1 >2013-12-04 11:44:08,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 49460c1 >2013-12-04 11:44:08,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39da8191 >2013-12-04 11:44:08,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74210fd2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baeefb5a}, log id: 39da8191 >2013-12-04 11:44:13,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6cb6baea >2013-12-04 11:44:14,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6cb6baea >2013-12-04 11:44:14,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 530f78d5 >2013-12-04 11:44:14,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@447e1654, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b31a107}, log id: 530f78d5 >2013-12-04 11:44:19,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 738766cb >2013-12-04 11:44:20,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 738766cb >2013-12-04 11:44:20,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 638ef271 >2013-12-04 11:44:20,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@addbdcf3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@945e2053}, log id: 638ef271 >2013-12-04 11:44:25,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78718317 >2013-12-04 11:44:25,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 78718317 >2013-12-04 11:44:25,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5910ca94 >2013-12-04 11:44:26,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96529814, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@569af8db}, log id: 5910ca94 >2013-12-04 11:44:31,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41d67bb1 >2013-12-04 11:44:31,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 41d67bb1 >2013-12-04 11:44:31,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 35676628 >2013-12-04 11:44:32,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3163cd59, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58bddb07}, log id: 35676628 >2013-12-04 11:44:33,419 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) No up server in cluster >2013-12-04 11:44:33,419 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:44:33,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 11761c6b >2013-12-04 11:44:33,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, return: [], log id: 11761c6b >2013-12-04 11:44:37,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e30e1f6 >2013-12-04 11:44:37,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4e30e1f6 >2013-12-04 11:44:37,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20c4aa73 >2013-12-04 11:44:37,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8ce1d43, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@680e193c}, log id: 20c4aa73 >2013-12-04 11:44:42,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 39de20c5 >2013-12-04 11:44:43,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 39de20c5 >2013-12-04 11:44:43,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6192c4d0 >2013-12-04 11:44:43,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37e41696, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50e4c3e9}, log id: 6192c4d0 >2013-12-04 11:44:48,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 271f3253 >2013-12-04 11:44:49,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 271f3253 >2013-12-04 11:44:49,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 563604bd >2013-12-04 11:44:49,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d378dbf2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f15a2d6}, log id: 563604bd >2013-12-04 11:44:51,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 76ef4b60 >2013-12-04 11:44:51,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@62de9e04, log id: 76ef4b60 >2013-12-04 11:44:51,945 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-27) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:44:51,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 76cff624 >2013-12-04 11:44:52,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6b789ba0, log id: 76cff624 >2013-12-04 11:44:54,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 537265e6 >2013-12-04 11:44:55,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 537265e6 >2013-12-04 11:44:55,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 692649a >2013-12-04 11:44:55,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd630352, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c93084fc}, log id: 692649a >2013-12-04 11:45:00,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 69ea1ed4 >2013-12-04 11:45:00,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 69ea1ed4 >2013-12-04 11:45:00,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 28ff1514 >2013-12-04 11:45:01,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63e95113, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69a3ddb4}, log id: 28ff1514 >2013-12-04 11:45:06,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: e951a99 >2013-12-04 11:45:06,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: e951a99 >2013-12-04 11:45:06,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 19c7c2e0 >2013-12-04 11:45:06,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7de099a6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7b383e3}, log id: 19c7c2e0 >2013-12-04 11:45:11,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3a3fe3f5 >2013-12-04 11:45:12,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a3fe3f5 >2013-12-04 11:45:12,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2874b4f0 >2013-12-04 11:45:12,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9c4d600, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c10cb6ff}, log id: 2874b4f0 >2013-12-04 11:45:17,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e23d842 >2013-12-04 11:45:18,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2e23d842 >2013-12-04 11:45:18,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2526a316 >2013-12-04 11:45:18,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2df5ca17, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e70fa50d}, log id: 2526a316 >2013-12-04 11:45:23,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63d02885 >2013-12-04 11:45:24,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 63d02885 >2013-12-04 11:45:24,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 753e91a9 >2013-12-04 11:45:24,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adb3e7b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89f25127}, log id: 753e91a9 >2013-12-04 11:45:29,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3e477b84 >2013-12-04 11:45:29,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3e477b84 >2013-12-04 11:45:29,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 790ede02 >2013-12-04 11:45:30,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [54e92961] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3227f29, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6904359e}, log id: 790ede02 >2013-12-04 11:45:33,729 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) [5be76bf9] No up server in cluster >2013-12-04 11:45:33,729 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) [5be76bf9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:45:33,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: b9aad0c >2013-12-04 11:45:34,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [5be76bf9] FINISH, GlusterTasksListVDSCommand, return: [], log id: b9aad0c >2013-12-04 11:45:35,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 18201fc3 >2013-12-04 11:45:35,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 18201fc3 >2013-12-04 11:45:35,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 69de5f98 >2013-12-04 11:45:35,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@272fc94b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c60ec68}, log id: 69de5f98 >2013-12-04 11:45:40,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b785fba >2013-12-04 11:45:41,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2b785fba >2013-12-04 11:45:41,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 54ddd0d8 >2013-12-04 11:45:41,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7162eaa6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f1a251b}, log id: 54ddd0d8 >2013-12-04 11:45:46,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6b13e097 >2013-12-04 11:45:46,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6b13e097 >2013-12-04 11:45:46,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6a8caaf3 >2013-12-04 11:45:47,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0d78b7f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42f8385d}, log id: 6a8caaf3 >2013-12-04 11:45:52,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4299da29 >2013-12-04 11:45:52,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4299da29 >2013-12-04 11:45:52,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 23f5b276 >2013-12-04 11:45:52,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e6a4737, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8260cd08}, log id: 23f5b276 >2013-12-04 11:45:57,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40e6aa84 >2013-12-04 11:45:58,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 40e6aa84 >2013-12-04 11:45:58,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 37dfa21f >2013-12-04 11:45:58,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0286d4d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2d8ef93}, log id: 37dfa21f >2013-12-04 11:46:03,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4dfd43b2 >2013-12-04 11:46:04,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4dfd43b2 >2013-12-04 11:46:04,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d7b63c6 >2013-12-04 11:46:04,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@984a8165, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@861aed28}, log id: d7b63c6 >2013-12-04 11:46:09,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4c34b359 >2013-12-04 11:46:09,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c34b359 >2013-12-04 11:46:09,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 50e53b88 >2013-12-04 11:46:10,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb15da2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ba4ba87}, log id: 50e53b88 >2013-12-04 11:46:15,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 358d9e7d >2013-12-04 11:46:15,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 358d9e7d >2013-12-04 11:46:15,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1e3c460c >2013-12-04 11:46:15,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19922ae2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91058695}, log id: 1e3c460c >2013-12-04 11:46:20,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5a4a1cee >2013-12-04 11:46:21,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a4a1cee >2013-12-04 11:46:21,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 449e5bd8 >2013-12-04 11:46:21,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28f88738, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81e08ce1}, log id: 449e5bd8 >2013-12-04 11:46:26,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 67898b8d >2013-12-04 11:46:26,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 67898b8d >2013-12-04 11:46:26,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7bb31cd1 >2013-12-04 11:46:26,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d8c8d17, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a16b8690}, log id: 7bb31cd1 >2013-12-04 11:46:31,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3663c709 >2013-12-04 11:46:32,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3663c709 >2013-12-04 11:46:32,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 557f089d >2013-12-04 11:46:32,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe9a2a9d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b720f1cc}, log id: 557f089d >2013-12-04 11:46:34,015 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-04 11:46:34,016 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:46:34,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 11b1b4e5 >2013-12-04 11:46:34,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 11b1b4e5 >2013-12-04 11:46:37,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27a7f95e >2013-12-04 11:46:37,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 27a7f95e >2013-12-04 11:46:37,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d7cd790 >2013-12-04 11:46:38,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35f7f01f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@861fedbe}, log id: 7d7cd790 >2013-12-04 11:46:43,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 79ebf05 >2013-12-04 11:46:43,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 79ebf05 >2013-12-04 11:46:43,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5270846c >2013-12-04 11:46:43,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1da5626, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c97676d}, log id: 5270846c >2013-12-04 11:46:48,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2139a0c3 >2013-12-04 11:46:49,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2139a0c3 >2013-12-04 11:46:49,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 56fd688b >2013-12-04 11:46:49,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@459cb4a9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6d35826}, log id: 56fd688b >2013-12-04 11:46:54,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5cf35a7b >2013-12-04 11:46:54,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5cf35a7b >2013-12-04 11:46:54,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 73174c3b >2013-12-04 11:46:55,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b519cdea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6818787}, log id: 73174c3b >2013-12-04 11:47:00,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24582156 >2013-12-04 11:47:00,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 24582156 >2013-12-04 11:47:00,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3fab9acf >2013-12-04 11:47:00,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3943e738, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e8ac975}, log id: 3fab9acf >2013-12-04 11:47:05,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 10f30d70 >2013-12-04 11:47:06,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 10f30d70 >2013-12-04 11:47:06,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: cb44c14 >2013-12-04 11:47:06,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6446fb4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bf49b10}, log id: cb44c14 >2013-12-04 11:47:11,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 79489291 >2013-12-04 11:47:11,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 79489291 >2013-12-04 11:47:11,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 346bf214 >2013-12-04 11:47:12,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [328ba2d1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ded4dd08, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c1ef8a8}, log id: 346bf214 >2013-12-04 11:47:17,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b627df9 >2013-12-04 11:47:17,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5b627df9 >2013-12-04 11:47:17,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: fb6c5e8 >2013-12-04 11:47:17,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77029b2b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39731c97}, log id: fb6c5e8 >2013-12-04 11:47:22,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 39ad485c >2013-12-04 11:47:22,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 39ad485c >2013-12-04 11:47:22,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 9c3b21e >2013-12-04 11:47:23,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bdb5936, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3718b8d1}, log id: 9c3b21e >2013-12-04 11:47:28,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 28cc5e9b >2013-12-04 11:47:28,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 28cc5e9b >2013-12-04 11:47:28,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7a46be5d >2013-12-04 11:47:28,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba233a08, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7f000ad}, log id: 7a46be5d >2013-12-04 11:47:33,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 44d0d126 >2013-12-04 11:47:34,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 44d0d126 >2013-12-04 11:47:34,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3f3c47a >2013-12-04 11:47:34,241 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-04 11:47:34,241 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:47:34,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 51e2cc4f >2013-12-04 11:47:34,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e82b047, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a5fe977}, log id: 3f3c47a >2013-12-04 11:47:34,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: 51e2cc4f >2013-12-04 11:47:39,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3923d977 >2013-12-04 11:47:39,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3923d977 >2013-12-04 11:47:39,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 549a0c24 >2013-12-04 11:47:40,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35ea9a31, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc2d092d}, log id: 549a0c24 >2013-12-04 11:47:45,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 32b20f1d >2013-12-04 11:47:45,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 32b20f1d >2013-12-04 11:47:45,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28ab07fc >2013-12-04 11:47:45,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e08e587b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28b1700a}, log id: 28ab07fc >2013-12-04 11:47:50,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6afbd9ef >2013-12-04 11:47:51,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6afbd9ef >2013-12-04 11:47:51,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6789875c >2013-12-04 11:47:51,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9de27c89, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f349d36c}, log id: 6789875c >2013-12-04 11:47:56,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 202f3878 >2013-12-04 11:47:56,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 202f3878 >2013-12-04 11:47:56,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 338d7cf1 >2013-12-04 11:47:57,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed34cfc8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acfe682d}, log id: 338d7cf1 >2013-12-04 11:48:02,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: f2bb34e >2013-12-04 11:48:02,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: f2bb34e >2013-12-04 11:48:02,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7e729ee9 >2013-12-04 11:48:02,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b120345e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eaadbb4f}, log id: 7e729ee9 >2013-12-04 11:48:07,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2d767a35 >2013-12-04 11:48:08,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d767a35 >2013-12-04 11:48:08,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6e65efee >2013-12-04 11:48:08,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4e69b49, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74230330}, log id: 6e65efee >2013-12-04 11:48:13,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 63ca4eb >2013-12-04 11:48:14,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 63ca4eb >2013-12-04 11:48:14,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1052ba54 >2013-12-04 11:48:14,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35dea398, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9855509}, log id: 1052ba54 >2013-12-04 11:48:19,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 183a30be >2013-12-04 11:48:19,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 183a30be >2013-12-04 11:48:19,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 600bdd3 >2013-12-04 11:48:20,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80538315, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63ee8b34}, log id: 600bdd3 >2013-12-04 11:48:25,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 623899bc >2013-12-04 11:48:25,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 623899bc >2013-12-04 11:48:25,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6d9c7460 >2013-12-04 11:48:25,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [18d9f4d0] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aca5667b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@542128b6}, log id: 6d9c7460 >2013-12-04 11:48:30,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2f8508b4 >2013-12-04 11:48:31,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2f8508b4 >2013-12-04 11:48:31,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2ae86a45 >2013-12-04 11:48:31,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb6366da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2022bb36}, log id: 2ae86a45 >2013-12-04 11:48:34,496 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2013-12-04 11:48:34,496 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:48:34,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3bac39bb >2013-12-04 11:48:34,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3bac39bb >2013-12-04 11:48:36,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5de4c83f >2013-12-04 11:48:36,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5de4c83f >2013-12-04 11:48:36,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3404a2f >2013-12-04 11:48:37,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3542483d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65028e47}, log id: 3404a2f >2013-12-04 11:48:42,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6d0a82e0 >2013-12-04 11:48:42,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6d0a82e0 >2013-12-04 11:48:42,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 36e980bc >2013-12-04 11:48:42,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53337c15, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae07f3af}, log id: 36e980bc >2013-12-04 11:48:47,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6ccc03cd >2013-12-04 11:48:48,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6ccc03cd >2013-12-04 11:48:48,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6822a29c >2013-12-04 11:48:48,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42d81d08, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f485251c}, log id: 6822a29c >2013-12-04 11:48:53,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 47ddfd43 >2013-12-04 11:48:53,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 47ddfd43 >2013-12-04 11:48:53,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5649789c >2013-12-04 11:48:54,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@626452a2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ce68d96}, log id: 5649789c >2013-12-04 11:48:59,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 49d3d409 >2013-12-04 11:48:59,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 49d3d409 >2013-12-04 11:48:59,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: ae5727f >2013-12-04 11:48:59,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14e5a8af, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b7a3503}, log id: ae5727f >2013-12-04 11:49:04,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 51dea697 >2013-12-04 11:49:05,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 51dea697 >2013-12-04 11:49:05,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 40e2f943 >2013-12-04 11:49:05,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b73100c0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fe08850}, log id: 40e2f943 >2013-12-04 11:49:10,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 52dd8bf4 >2013-12-04 11:49:10,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 52dd8bf4 >2013-12-04 11:49:10,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 247c760f >2013-12-04 11:49:10,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7affc9bf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7eb86a33}, log id: 247c760f >2013-12-04 11:49:16,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3ddc0c12 >2013-12-04 11:49:16,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ddc0c12 >2013-12-04 11:49:16,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2149720f >2013-12-04 11:49:16,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [4ca24342] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@698ead2b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d094208}, log id: 2149720f >2013-12-04 11:49:21,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3f9bd7f >2013-12-04 11:49:22,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3f9bd7f >2013-12-04 11:49:22,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f645bac >2013-12-04 11:49:22,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [6d2d632b] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e62eee1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41e87ed9}, log id: 5f645bac >2013-12-04 11:49:27,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 690678d2 >2013-12-04 11:49:27,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 690678d2 >2013-12-04 11:49:27,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5884485 >2013-12-04 11:49:27,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0d0c9fc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbcd3f66}, log id: 5884485 >2013-12-04 11:49:32,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5df78dc >2013-12-04 11:49:33,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5df78dc >2013-12-04 11:49:33,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 604de5af >2013-12-04 11:49:33,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [1f01d1f] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8a301ee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8985a0ff}, log id: 604de5af >2013-12-04 11:49:34,775 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) No up server in cluster >2013-12-04 11:49:34,782 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:49:34,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c2a73d >2013-12-04 11:49:35,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5c2a73d >2013-12-04 11:49:38,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2f7babf1 >2013-12-04 11:49:39,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2f7babf1 >2013-12-04 11:49:39,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 44ab612a >2013-12-04 11:49:39,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) [49a6fca1] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec1dea17, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce75ebf0}, log id: 44ab612a >2013-12-04 11:49:44,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: ab36ef6 >2013-12-04 11:49:45,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: ab36ef6 >2013-12-04 11:49:45,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2df24fc8 >2013-12-04 11:49:45,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5281ede, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a502a096}, log id: 2df24fc8 >2013-12-04 11:49:50,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2d41e2d0 >2013-12-04 11:49:50,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2d41e2d0 >2013-12-04 11:49:50,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 75b22971 >2013-12-04 11:49:51,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [6e7f0088] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edc95d09, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76d4d11a}, log id: 75b22971 >2013-12-04 11:49:52,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3103fe8b >2013-12-04 11:49:52,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6257f8b9, log id: 3103fe8b >2013-12-04 11:49:52,595 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-58) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor117.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:49:52,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7d8a6c1f >2013-12-04 11:49:52,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5b9cf327, log id: 7d8a6c1f >2013-12-04 11:49:56,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1ee30dac >2013-12-04 11:49:56,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1ee30dac >2013-12-04 11:49:56,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 690c56d7 >2013-12-04 11:49:57,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad835412, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7d678ee}, log id: 690c56d7 >2013-12-04 11:50:02,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a12a6a1 >2013-12-04 11:50:02,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7a12a6a1 >2013-12-04 11:50:02,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 43c7333a >2013-12-04 11:50:02,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1fbd26f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76975b7}, log id: 43c7333a >2013-12-04 11:50:07,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 47f3d7e >2013-12-04 11:50:08,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 47f3d7e >2013-12-04 11:50:08,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4f543bc8 >2013-12-04 11:50:08,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) [73a35da9] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@223e9079, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f9b94a7}, log id: 4f543bc8 >2013-12-04 11:50:13,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5e3eb040 >2013-12-04 11:50:14,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e3eb040 >2013-12-04 11:50:14,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2620b273 >2013-12-04 11:50:14,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62094055, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd5bfb22}, log id: 2620b273 >2013-12-04 11:50:19,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 39db6a04 >2013-12-04 11:50:20,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 39db6a04 >2013-12-04 11:50:20,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 463bfbd7 >2013-12-04 11:50:20,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9929d36a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccfebe2}, log id: 463bfbd7 >2013-12-04 11:50:25,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5bb85f57 >2013-12-04 11:50:26,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5bb85f57 >2013-12-04 11:50:26,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3406e285 >2013-12-04 11:50:26,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94f2704d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3810004}, log id: 3406e285 >2013-12-04 11:50:31,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2c99d21c >2013-12-04 11:50:32,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c99d21c >2013-12-04 11:50:32,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: a5404c5 >2013-12-04 11:50:32,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a01c3d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4b8c581}, log id: a5404c5 >2013-12-04 11:50:35,153 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2013-12-04 11:50:35,154 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:50:35,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10e9d58a >2013-12-04 11:50:35,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 10e9d58a >2013-12-04 11:50:37,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 88d9114 >2013-12-04 11:50:37,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 88d9114 >2013-12-04 11:50:37,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 531722fa >2013-12-04 11:50:38,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1538fa6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70d2e3c0}, log id: 531722fa >2013-12-04 11:50:43,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 149dc22a >2013-12-04 11:50:43,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 149dc22a >2013-12-04 11:50:43,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 704df5d7 >2013-12-04 11:50:44,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3f45b52d] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfca9f8f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efd0fa80}, log id: 704df5d7 >2013-12-04 11:50:49,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3979045c >2013-12-04 11:50:49,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3979045c >2013-12-04 11:50:49,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41ca8223 >2013-12-04 11:50:49,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea3bd0ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2dcebb1}, log id: 41ca8223 >2013-12-04 11:50:54,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 276d9733 >2013-12-04 11:50:55,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 276d9733 >2013-12-04 11:50:55,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1313f35 >2013-12-04 11:50:55,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f3e9847, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e119d31}, log id: 1313f35 >2013-12-04 11:51:00,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29e69819 >2013-12-04 11:51:01,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 29e69819 >2013-12-04 11:51:01,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b5c60e3 >2013-12-04 11:51:01,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1e831a3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@977688a6}, log id: 5b5c60e3 >2013-12-04 11:51:06,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7dda99d9 >2013-12-04 11:51:07,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7dda99d9 >2013-12-04 11:51:07,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4904a202 >2013-12-04 11:51:07,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d7b3de6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@626e0f69}, log id: 4904a202 >2013-12-04 11:51:12,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 62f54c8c >2013-12-04 11:51:12,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 62f54c8c >2013-12-04 11:51:12,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5e19f426 >2013-12-04 11:51:13,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@695ba3b9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15d28326}, log id: 5e19f426 >2013-12-04 11:51:18,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 33bdadc8 >2013-12-04 11:51:18,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 33bdadc8 >2013-12-04 11:51:18,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a1b73b1 >2013-12-04 11:51:19,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5416e111, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd1b7017}, log id: a1b73b1 >2013-12-04 11:51:24,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 58cb229e >2013-12-04 11:51:24,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 58cb229e >2013-12-04 11:51:24,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 30149be >2013-12-04 11:51:25,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f5a09fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d14b5442}, log id: 30149be >2013-12-04 11:51:30,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 425138b1 >2013-12-04 11:51:30,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 425138b1 >2013-12-04 11:51:30,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 179f052e >2013-12-04 11:51:30,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@663d0767, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa55c0a4}, log id: 179f052e >2013-12-04 11:51:35,497 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-04 11:51:35,499 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-04 11:51:35,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 32481f9f >2013-12-04 11:51:35,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 32481f9f >2013-12-04 11:51:35,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 64f1a41 >2013-12-04 11:51:36,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 64f1a41 >2013-12-04 11:51:36,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1217ce76 >2013-12-04 11:51:36,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@459a20aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfe76183}, log id: 1217ce76 >2013-12-04 11:51:41,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4987f3e7 >2013-12-04 11:51:42,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4987f3e7 >2013-12-04 11:51:42,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e3707ee >2013-12-04 11:51:42,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee9006b0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d2a93b1}, log id: 4e3707ee >2013-12-04 11:51:47,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6ec9ebb1 >2013-12-04 11:51:48,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6ec9ebb1 >2013-12-04 11:51:48,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 10046c6c >2013-12-04 11:51:48,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f316e1ca, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26cfd1d2}, log id: 10046c6c >2013-12-04 11:51:53,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f9351e8 >2013-12-04 11:51:54,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7f9351e8 >2013-12-04 11:51:54,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5b584c27 >2013-12-04 11:51:54,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89172fd0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47c45847}, log id: 5b584c27 >2013-12-04 11:51:59,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 22705312 >2013-12-04 11:52:00,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 22705312 >2013-12-04 11:52:00,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ad4b16f >2013-12-04 11:52:00,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee8c29d7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f550847}, log id: 7ad4b16f >2013-12-04 11:52:05,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12d01582 >2013-12-04 11:52:05,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 12d01582 >2013-12-04 11:52:05,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39ec3081 >2013-12-04 11:52:06,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22b56885, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ef157cc}, log id: 39ec3081 >2013-12-04 11:52:11,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 76aca2a4 >2013-12-04 11:52:11,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 76aca2a4 >2013-12-04 11:52:11,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 41ff1292 >2013-12-04 11:52:11,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b069a7cc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2bf0581}, log id: 41ff1292 >2013-12-05 04:58:14,490 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". >2013-12-05 04:58:14,539 WARN [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. >2013-12-05 04:58:14,539 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". >2013-12-05 04:58:14,539 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". >2013-12-05 04:58:14,540 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". >2013-12-05 04:58:14,540 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". >2013-12-05 04:58:14,540 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Loaded file "/etc/ovirt-engine/engine.conf.d/50-redhat-access-plugin.conf". >2013-12-05 04:58:14,540 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_AJP_ENABLED" is "true". >2013-12-05 04:58:14,540 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_AJP_PORT" is "8702". >2013-12-05 04:58:14,540 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_APPS" is "engine.ear redhat-access-plugin-rhsc.ear". >2013-12-05 04:58:14,540 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". >2013-12-05 04:58:14,541 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". >2013-12-05 04:58:14,549 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". >2013-12-05 04:58:14,549 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_DATABASE" is "engine". >2013-12-05 04:58:14,549 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". >2013-12-05 04:58:14,549 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_HOST" is "localhost". >2013-12-05 04:58:14,549 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". >2013-12-05 04:58:14,549 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". >2013-12-05 04:58:14,550 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_PASSWORD" is "***". >2013-12-05 04:58:14,550 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_PORT" is "5432". >2013-12-05 04:58:14,550 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_SECURED" is "False". >2013-12-05 04:58:14,550 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". >2013-12-05 04:58:14,550 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_SSL" is "false". >2013-12-05 04:58:14,550 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". >2013-12-05 04:58:14,550 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DB_USER" is "engine". >2013-12-05 04:58:14,550 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DEBUG_ADDRESS" is "". >2013-12-05 04:58:14,550 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". >2013-12-05 04:58:14,550 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". >2013-12-05 04:58:14,550 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_FQDN" is "rhsc.cb10". >2013-12-05 04:58:14,550 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_GROUP" is "ovirt". >2013-12-05 04:58:14,550 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HEAP_MAX" is "1g". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HEAP_MIN" is "1g". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTPS_ENABLED" is "false". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTPS_PORT" is "None". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTP_ENABLED" is "false". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_HTTP_PORT" is "None". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_MANUAL" is "/usr/share/ovirt-engine/manual". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PERM_MAX" is "256m". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PERM_MIN" is "256m". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". >2013-12-05 04:58:14,551 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PROXY_ENABLED" is "true". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_STOP_INTERVAL" is "1". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_STOP_TIME" is "10". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". >2013-12-05 04:58:14,552 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_USER" is "ovirt". >2013-12-05 04:58:14,553 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". >2013-12-05 04:58:14,553 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". >2013-12-05 04:58:14,553 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "ENGINE_VERBOSE_GC" is "false". >2013-12-05 04:58:14,553 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "JBOSS_HOME" is "/usr/share/jbossas". >2013-12-05 04:58:14,553 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 38) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD". >2013-12-05 04:58:15,539 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 40) Start initializing Backend >2013-12-05 04:58:16,410 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 40) Running ovirt-engine 2.1.2-0.26.master.el6_5 >2013-12-05 04:58:16,413 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 40) Start initializing dictionaries >2013-12-05 04:58:16,417 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 40) Finished initializing dictionaries >2013-12-05 04:58:16,418 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 40) Start initializing AuditLogCleanupManager >2013-12-05 04:58:16,419 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 40) Setting audit cleanup manager to run at: 35 35 3 * * ? >2013-12-05 04:58:16,454 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 40) Finished initializing AuditLogCleanupManager >2013-12-05 04:58:16,458 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 40) Start initializing TagsDirector >2013-12-05 04:58:16,472 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 40) Tag root added to tree >2013-12-05 04:58:16,513 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 40) Finished initializing TagsDirector >2013-12-05 04:58:16,516 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 40) Start initializing IsoDomainListSyncronizer >2013-12-05 04:58:16,522 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 40) Finished initializing IsoDomainListSyncronizer >2013-12-05 04:58:16,559 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 40) Loaded file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties >2013-12-05 04:58:16,856 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 40) Completed initializing handlers >2013-12-05 04:58:16,858 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 40) Start initializing ErrorTranslatorImpl >2013-12-05 04:58:16,880 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 40) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. >2013-12-05 04:58:16,882 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 40) Finished initializing ErrorTranslatorImpl >2013-12-05 04:58:16,882 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 40) Start initializing ErrorTranslatorImpl >2013-12-05 04:58:16,883 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 40) Finished initializing ErrorTranslatorImpl >2013-12-05 04:58:16,884 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 40) Mark incomplete jobs as UNKNOWN >2013-12-05 04:58:16,976 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 40) Start initializing JobRepositoryCleanupManager >2013-12-05 04:58:16,977 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 40) Finished initializing JobRepositoryCleanupManager >2013-12-05 04:58:16,978 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 40) Start initializing AutoRecoveryManager >2013-12-05 04:58:16,980 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 40) Finished initializing AutoRecoveryManager >2013-12-05 04:58:16,982 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 40) Start initializing ExecutionMessageDirector >2013-12-05 04:58:16,983 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 40) Finished initializing ExecutionMessageDirector >2013-12-05 04:58:17,138 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 43) Start initializing UsersDomainsCacheManagerService >2013-12-05 04:58:17,163 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 43) Start initializing DbUserCacheManager >2013-12-05 04:58:17,163 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 43) Finished initializing DbUserCacheManager >2013-12-05 04:58:17,163 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 43) Finished initializing UsersDomainsCacheManagerService >2013-12-05 04:58:17,216 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ServerService Thread Pool -- 38) Initialization of AsyncTaskManager completed successfully. >2013-12-05 04:58:17,219 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) Start initializing ResourceManager >2013-12-05 04:58:17,224 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-1) Start refreshing all users data >2013-12-05 04:58:17,566 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) Entered VdsManager constructor >2013-12-05 04:58:17,625 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) Initialize vdsBroker (10.70.37.147,54,321) >2013-12-05 04:58:17,897 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) VDS 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61 was added to the Resource Manager >2013-12-05 04:58:17,897 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) Entered VdsManager constructor >2013-12-05 04:58:17,911 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) Initialize vdsBroker (10.70.37.118,54,321) >2013-12-05 04:58:17,916 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) VDS 29276a10-e580-47a3-8d4a-5be883880e91 was added to the Resource Manager >2013-12-05 04:58:17,916 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) Entered VdsManager constructor >2013-12-05 04:58:17,930 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) Initialize vdsBroker (10.70.37.74,54,321) >2013-12-05 04:58:17,934 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) VDS 4c17e50e-8225-48c6-bcb3-bfba4ec37037 was added to the Resource Manager >2013-12-05 04:58:17,935 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) Entered VdsManager constructor >2013-12-05 04:58:17,946 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) Initialize vdsBroker (10.70.37.155,54,321) >2013-12-05 04:58:17,952 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) VDS fce21e1b-8581-4c72-bf3c-7db552d78d13 was added to the Resource Manager >2013-12-05 04:58:17,998 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) Finished initializing ResourceManager >2013-12-05 04:58:18,010 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (ServerService Thread Pool -- 38) Initialization of OvfDataUpdater completed successfully. >2013-12-05 04:58:18,014 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) Start scheduling to enable vds load balancer >2013-12-05 04:58:18,019 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) Finished scheduling to enable vds load balancer >2013-12-05 04:58:18,039 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (pool-4-thread-1) MacPoolManager(573cb0e8): Start initializing >2013-12-05 04:58:18,060 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) Init VM custom properties utilities >2013-12-05 04:58:18,086 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (pool-4-thread-1) MacPoolManager(573cb0e8): Finished initializing >2013-12-05 04:58:18,086 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) Init device custom properties utilities >2013-12-05 04:58:18,090 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) Initializing Scheduling manager >2013-12-05 04:58:18,143 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) External scheduler disabled, discovery skipped >2013-12-05 04:58:18,143 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) Initialized Scheduling manager >2013-12-05 04:58:18,144 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 38) Initializing DWH Heart Beat >2013-12-05 04:58:21,726 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GetHardwareInfoVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61, vds=Host[host4]), log id: 460323b2 >2013-12-05 04:58:21,743 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GetHardwareInfoVDSCommand, log id: 460323b2 >2013-12-05 04:58:21,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2119f2e8 >2013-12-05 04:58:21,919 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GetHardwareInfoVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13, vds=Host[host3]), log id: 2aaed829 >2013-12-05 04:58:21,941 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GetHardwareInfoVDSCommand, log id: 2aaed829 >2013-12-05 04:58:21,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 180baacc >2013-12-05 04:58:22,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037, vds=Host[host1]), log id: 3f5737e7 >2013-12-05 04:58:22,032 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GetHardwareInfoVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91, vds=Host[host2]), log id: 6306db0c >2013-12-05 04:58:22,035 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GetHardwareInfoVDSCommand, log id: 3f5737e7 >2013-12-05 04:58:22,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: cc514b >2013-12-05 04:58:22,054 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GetHardwareInfoVDSCommand, log id: 6306db0c >2013-12-05 04:58:22,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7595fd83 >2013-12-05 04:58:22,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2119f2e8 >2013-12-05 04:58:22,297 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: UNASSIGNED not exist in string table >2013-12-05 04:58:22,297 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table >2013-12-05 04:58:22,298 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2013-12-05 04:58:22,298 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: GLUSTER_VOLUME_REMOVE_BRICKS_STOP not exist in string table >2013-12-05 04:58:22,298 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: GLUSTER_VOLUME_REMOVE_BRICKS_STOP_FAILED not exist in string table >2013-12-05 04:58:22,298 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2013-12-05 04:58:22,298 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2013-12-05 04:58:22,299 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: DWH_STOPPED not exist in string table >2013-12-05 04:58:22,299 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: DWH_STARTED not exist in string table >2013-12-05 04:58:22,299 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: DWH_ERROR not exist in string table >2013-12-05 04:58:22,308 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_FAILED_REMOVE_VM not have severity. Assumed Normal >2013-12-05 04:58:22,308 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2013-12-05 04:58:22,308 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2013-12-05 04:58:22,308 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2013-12-05 04:58:22,309 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not have severity. Assumed Normal >2013-12-05 04:58:22,309 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: GLUSTER_VOLUME_OPTION_CHANGED_FROM_CLI not have severity. Assumed Normal >2013-12-05 04:58:22,309 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: GLUSTER_SERVICES_LIST_NOT_FETCHED not have severity. Assumed Normal >2013-12-05 04:58:22,309 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: GLUSTER_VOLUME_BRICK_ADDED not have severity. Assumed Normal >2013-12-05 04:58:22,309 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_EXTEND_DISK_SIZE_UPDATE_VM_FAILURE not have severity. Assumed Normal >2013-12-05 04:58:22,309 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: VM_MIGRATION_START_SYSTEM_INITIATED not have severity. Assumed Normal >2013-12-05 04:58:22,309 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not have severity. Assumed Normal >2013-12-05 04:58:22,309 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_UP not have severity. Assumed Normal >2013-12-05 04:58:22,310 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_DOWN not have severity. Assumed Normal >2013-12-05 04:58:22,310 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_UPDATED_MOM_POLICIES not have severity. Assumed Normal >2013-12-05 04:58:22,310 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) AuditLogType: USER_FAILED_TO_UPDATE_MOM_POLICIES not have severity. Assumed Normal >2013-12-05 04:58:22,458 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host host4. >2013-12-05 04:58:22,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 180baacc >2013-12-05 04:58:22,497 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host host3. >2013-12-05 04:58:22,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7595fd83 >2013-12-05 04:58:22,539 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host host2. >2013-12-05 04:58:22,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: cc514b >2013-12-05 04:58:22,566 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host host1. >2013-12-05 04:58:22,565 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-3) Initializing Host: host4 >2013-12-05 04:58:22,573 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-4) Initializing Host: host2 >2013-12-05 04:58:22,579 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) Initializing Host: host3 >2013-12-05 04:58:22,642 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-5) Initializing Host: host1 >2013-12-05 04:58:22,818 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-5) [18c3ff07] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 4c17e50e-8225-48c6-bcb3-bfba4ec37037 Type: VDS >2013-12-05 04:58:22,818 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-6) [3d5b2cda] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: fce21e1b-8581-4c72-bf3c-7db552d78d13 Type: VDS >2013-12-05 04:58:22,817 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-4) [2a8bc1b8] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 29276a10-e580-47a3-8d4a-5be883880e91 Type: VDS >2013-12-05 04:58:22,818 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-3) [447df991] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61 Type: VDS >2013-12-05 04:58:23,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 374ada7c >2013-12-05 04:58:23,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 374ada7c >2013-12-05 04:58:23,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3fb9f67a >2013-12-05 04:58:23,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6be2d935, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c935688}, log id: 3fb9f67a >2013-12-05 04:58:29,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 57bb83e3 >2013-12-05 04:58:29,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 57bb83e3 >2013-12-05 04:58:29,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 44114ad7 >2013-12-05 04:58:30,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75f016a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6098b714}, log id: 44114ad7 >2013-12-05 04:58:35,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 31d51def >2013-12-05 04:58:35,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 31d51def >2013-12-05 04:58:35,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6366e0c6 >2013-12-05 04:58:35,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ec85ff8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48ec4a53}, log id: 6366e0c6 >2013-12-05 04:58:40,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4a8f9390 >2013-12-05 04:58:41,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a8f9390 >2013-12-05 04:58:41,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1fe7a8f8 >2013-12-05 04:58:41,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42859a65, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f256a02}, log id: 1fe7a8f8 >2013-12-05 04:58:46,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3a4a9bed >2013-12-05 04:58:47,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a4a9bed >2013-12-05 04:58:47,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3aa3cb25 >2013-12-05 04:58:47,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70a95794, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab836a5c}, log id: 3aa3cb25 >2013-12-05 04:58:52,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: b5d81e3 >2013-12-05 04:58:53,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: b5d81e3 >2013-12-05 04:58:53,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6c4d8ad3 >2013-12-05 04:58:53,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9498361c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb9b2340}, log id: 6c4d8ad3 >2013-12-05 04:58:58,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1a4cc53f >2013-12-05 04:58:59,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1a4cc53f >2013-12-05 04:58:59,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6765ecb1 >2013-12-05 04:58:59,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7d10afe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab6cd354}, log id: 6765ecb1 >2013-12-05 04:59:04,249 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-1) Reading UI plugin descriptor [/usr/share/ovirt-engine/ui-plugins/redhat-access-plugin-rhsc.json] >2013-12-05 04:59:04,279 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-1) Reading UI plugin configuration [/etc/ovirt-engine/ui-plugins/redhat-access-plugin-rhsc-config.json] >2013-12-05 04:59:04,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77f4565b >2013-12-05 04:59:04,670 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-3) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-05 04:59:04,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 77f4565b >2013-12-05 04:59:04,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7775e1ba >2013-12-05 04:59:05,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd40ea6c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd9d48d8}, log id: 7775e1ba >2013-12-05 04:59:05,756 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-11) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-05 04:59:10,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d0d2da6 >2013-12-05 04:59:10,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: d0d2da6 >2013-12-05 04:59:10,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 25f8e69a >2013-12-05 04:59:11,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2134bf8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7490bf37}, log id: 25f8e69a >2013-12-05 04:59:11,872 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-12) Running command: LoginAdminUserCommand internal: false. >2013-12-05 04:59:11,914 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2013-12-05 04:59:13,105 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-7) Running command: LoginUserCommand internal: false. >2013-12-05 04:59:13,115 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2013-12-05 04:59:16,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 540ef69b >2013-12-05 04:59:16,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 540ef69b >2013-12-05 04:59:16,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3440e765 >2013-12-05 04:59:16,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f4fa47e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3fb1e1b}, log id: 3440e765 >2013-12-05 04:59:18,064 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) No up server in cluster >2013-12-05 04:59:18,066 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 04:59:18,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 79ac269e >2013-12-05 04:59:18,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterTasksListVDSCommand, return: [], log id: 79ac269e >2013-12-05 04:59:18,999 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-1) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-05 04:59:21,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 472f1af0 >2013-12-05 04:59:22,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 472f1af0 >2013-12-05 04:59:22,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b814894 >2013-12-05 04:59:22,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28db785c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3178ed1e}, log id: 2b814894 >2013-12-05 04:59:27,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b13cf90 >2013-12-05 04:59:28,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2b13cf90 >2013-12-05 04:59:28,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 26aaeb48 >2013-12-05 04:59:28,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26983f97, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7120141a}, log id: 26aaeb48 >2013-12-05 04:59:33,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1d4c7940 >2013-12-05 04:59:34,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d4c7940 >2013-12-05 04:59:34,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5e8814f1 >2013-12-05 04:59:34,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b56cc890, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34d42157}, log id: 5e8814f1 >2013-12-05 04:59:39,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1c2c4207 >2013-12-05 04:59:39,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1c2c4207 >2013-12-05 04:59:39,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1eedfe42 >2013-12-05 04:59:40,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0ff1929, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be1f8924}, log id: 1eedfe42 >2013-12-05 04:59:45,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5ecfcd44 >2013-12-05 04:59:45,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5ecfcd44 >2013-12-05 04:59:45,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 22a19659 >2013-12-05 04:59:46,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@329c31fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa573011}, log id: 22a19659 >2013-12-05 04:59:51,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 78b2963 >2013-12-05 04:59:51,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 78b2963 >2013-12-05 04:59:51,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1342c062 >2013-12-05 04:59:51,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5226e8b2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40c19075}, log id: 1342c062 >2013-12-05 04:59:56,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48816a5c >2013-12-05 04:59:57,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 48816a5c >2013-12-05 04:59:57,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67cee3c7 >2013-12-05 04:59:57,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b3760f5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a7314c9}, log id: 67cee3c7 >2013-12-05 05:00:02,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2a8bc1b8] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4d775ce6 >2013-12-05 05:00:03,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2a8bc1b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4d775ce6 >2013-12-05 05:00:03,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2a8bc1b8] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5a2c4647 >2013-12-05 05:00:03,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2a8bc1b8] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bf456b7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23485266}, log id: 5a2c4647 >2013-12-05 05:00:08,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 56221cb5 >2013-12-05 05:00:09,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 56221cb5 >2013-12-05 05:00:09,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55e507d9 >2013-12-05 05:00:09,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb764cd9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea0a7ab5}, log id: 55e507d9 >2013-12-05 05:00:14,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 472c61b6 >2013-12-05 05:00:14,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 472c61b6 >2013-12-05 05:00:14,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4cbe8a70 >2013-12-05 05:00:15,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c88af0f5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e68cc987}, log id: 4cbe8a70 >2013-12-05 05:00:18,371 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-05 05:00:18,371 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:00:18,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4293fe22 >2013-12-05 05:00:18,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4293fe22 >2013-12-05 05:00:20,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3a97323e >2013-12-05 05:00:20,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3a97323e >2013-12-05 05:00:20,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 506954f2 >2013-12-05 05:00:20,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2de5c1a8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d4e3902}, log id: 506954f2 >2013-12-05 05:00:25,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d6f2ea6 >2013-12-05 05:00:26,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1d6f2ea6 >2013-12-05 05:00:26,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e916289 >2013-12-05 05:00:26,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4d1929e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@484e0efd}, log id: 5e916289 >2013-12-05 05:00:31,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4a85e730 >2013-12-05 05:00:32,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4a85e730 >2013-12-05 05:00:32,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 48b7fff6 >2013-12-05 05:00:32,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca73315d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b64eae3}, log id: 48b7fff6 >2013-12-05 05:00:37,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5d674728 >2013-12-05 05:00:38,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5d674728 >2013-12-05 05:00:38,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 344dad0c >2013-12-05 05:00:38,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e545104, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2087a042}, log id: 344dad0c >2013-12-05 05:00:43,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 337121ac >2013-12-05 05:00:43,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 337121ac >2013-12-05 05:00:43,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6bd0619e >2013-12-05 05:00:44,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f6473f2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6852249}, log id: 6bd0619e >2013-12-05 05:00:49,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 407972f1 >2013-12-05 05:00:49,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 407972f1 >2013-12-05 05:00:49,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 302e9bdd >2013-12-05 05:00:49,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d12b429, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dff90e6e}, log id: 302e9bdd >2013-12-05 05:00:55,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 772fefb9 >2013-12-05 05:00:55,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 772fefb9 >2013-12-05 05:00:55,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7c136908 >2013-12-05 05:00:55,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a22f9ca2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd07eafe}, log id: 7c136908 >2013-12-05 05:01:00,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4cebafa1 >2013-12-05 05:01:01,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4cebafa1 >2013-12-05 05:01:01,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67c4fd44 >2013-12-05 05:01:01,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc77c182, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@806f0273}, log id: 67c4fd44 >2013-12-05 05:01:06,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 31b0c9a4 >2013-12-05 05:01:07,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 31b0c9a4 >2013-12-05 05:01:07,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 86176ba >2013-12-05 05:01:07,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fcc802, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0e9fca5}, log id: 86176ba >2013-12-05 05:01:12,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70c82547 >2013-12-05 05:01:12,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 70c82547 >2013-12-05 05:01:12,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f26dc17 >2013-12-05 05:01:13,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3a90c2b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee50bfc2}, log id: 7f26dc17 >2013-12-05 05:01:18,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 26805039 >2013-12-05 05:01:18,686 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) No up server in cluster >2013-12-05 05:01:18,686 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:01:18,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5675ed5e >2013-12-05 05:01:18,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 26805039 >2013-12-05 05:01:18,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2cc65f86 >2013-12-05 05:01:18,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5675ed5e >2013-12-05 05:01:19,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@820d0952, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2210942e}, log id: 2cc65f86 >2013-12-05 05:01:24,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 28bc85a8 >2013-12-05 05:01:24,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 28bc85a8 >2013-12-05 05:01:24,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 61819956 >2013-12-05 05:01:24,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d4b798a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe97580b}, log id: 61819956 >2013-12-05 05:01:29,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 62f0111c >2013-12-05 05:01:30,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 62f0111c >2013-12-05 05:01:30,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40160aee >2013-12-05 05:01:30,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebabb9b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55ac42a2}, log id: 40160aee >2013-12-05 05:01:35,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4cdd33f6 >2013-12-05 05:01:36,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4cdd33f6 >2013-12-05 05:01:36,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 20f7c8d2 >2013-12-05 05:01:36,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2544d85a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fdc604b}, log id: 20f7c8d2 >2013-12-05 05:01:41,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5c524a41 >2013-12-05 05:01:42,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5c524a41 >2013-12-05 05:01:42,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3bcb487a >2013-12-05 05:01:42,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37260ad1, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a58b2b10}, log id: 3bcb487a >2013-12-05 05:01:47,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5ed7db22 >2013-12-05 05:01:47,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5ed7db22 >2013-12-05 05:01:47,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40691fcc >2013-12-05 05:01:48,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d671173, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@905ba8f6}, log id: 40691fcc >2013-12-05 05:01:53,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 36cfb40 >2013-12-05 05:01:53,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 36cfb40 >2013-12-05 05:01:53,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 73272d97 >2013-12-05 05:01:53,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b70bf1d8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a04051ef}, log id: 73272d97 >2013-12-05 05:01:58,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 398503aa >2013-12-05 05:01:59,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 398503aa >2013-12-05 05:01:59,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: e30440c >2013-12-05 05:01:59,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dacc4d35, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24ebd36a}, log id: e30440c >2013-12-05 05:02:04,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4cba7d5 >2013-12-05 05:02:05,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4cba7d5 >2013-12-05 05:02:05,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1bea71da >2013-12-05 05:02:05,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7924bf21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@776fe134}, log id: 1bea71da >2013-12-05 05:02:10,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 47089238 >2013-12-05 05:02:11,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 47089238 >2013-12-05 05:02:11,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 14c02b59 >2013-12-05 05:02:11,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1aaa19dd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@399aa43a}, log id: 14c02b59 >2013-12-05 05:02:16,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: a06aa3e >2013-12-05 05:02:16,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: a06aa3e >2013-12-05 05:02:16,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4962194f >2013-12-05 05:02:17,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@229987bf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d8fc832}, log id: 4962194f >2013-12-05 05:02:18,998 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-83) No up server in cluster >2013-12-05 05:02:18,998 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-83) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:02:19,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 591c576d >2013-12-05 05:02:19,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterTasksListVDSCommand, return: [], log id: 591c576d >2013-12-05 05:02:22,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 261aaad5 >2013-12-05 05:02:22,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 261aaad5 >2013-12-05 05:02:22,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53c92c8d >2013-12-05 05:02:22,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8db5cd5c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5afd245}, log id: 53c92c8d >2013-12-05 05:02:27,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5e2a01d0 >2013-12-05 05:02:28,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5e2a01d0 >2013-12-05 05:02:28,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a8ff316 >2013-12-05 05:02:28,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a84bdee2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14ea608c}, log id: 1a8ff316 >2013-12-05 05:02:33,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4c82d090 >2013-12-05 05:02:34,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c82d090 >2013-12-05 05:02:34,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4f3b36fd >2013-12-05 05:02:34,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b19294cd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a3c5940}, log id: 4f3b36fd >2013-12-05 05:02:39,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6949c79 >2013-12-05 05:02:40,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6949c79 >2013-12-05 05:02:40,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3c36bb50 >2013-12-05 05:02:40,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a86f2c8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87b67873}, log id: 3c36bb50 >2013-12-05 05:02:45,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 767ac42b >2013-12-05 05:02:45,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 767ac42b >2013-12-05 05:02:45,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5831ac7d >2013-12-05 05:02:46,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1726471, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b74dd85a}, log id: 5831ac7d >2013-12-05 05:02:51,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5cc208a3 >2013-12-05 05:02:51,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5cc208a3 >2013-12-05 05:02:51,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e54b18b >2013-12-05 05:02:52,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ac47853, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@282c3cc7}, log id: 2e54b18b >2013-12-05 05:02:57,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5923eda >2013-12-05 05:02:57,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5923eda >2013-12-05 05:02:57,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5c95bffc >2013-12-05 05:02:57,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ebd2bee, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4e4b55d}, log id: 5c95bffc >2013-12-05 05:03:02,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 78b76988 >2013-12-05 05:03:03,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 78b76988 >2013-12-05 05:03:03,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6daa1ad6 >2013-12-05 05:03:03,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dca3e58, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@facd6ee9}, log id: 6daa1ad6 >2013-12-05 05:03:08,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4d3c09f5 >2013-12-05 05:03:09,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4d3c09f5 >2013-12-05 05:03:09,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 27aaad7f >2013-12-05 05:03:09,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93879dfd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@682a1057}, log id: 27aaad7f >2013-12-05 05:03:14,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 54527500 >2013-12-05 05:03:15,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 54527500 >2013-12-05 05:03:15,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 77abccb7 >2013-12-05 05:03:15,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d66b7cc6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@986d7cae}, log id: 77abccb7 >2013-12-05 05:03:18,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 75384ce5 >2013-12-05 05:03:18,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6a811a, log id: 75384ce5 >2013-12-05 05:03:18,342 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-1) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:03:18,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 114d6fde >2013-12-05 05:03:18,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@57b80c59, log id: 114d6fde >2013-12-05 05:03:19,303 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) [3d5b2cda] No up server in cluster >2013-12-05 05:03:19,303 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) [3d5b2cda] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:03:19,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [3d5b2cda] START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e79e89 >2013-12-05 05:03:19,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [3d5b2cda] FINISH, GlusterTasksListVDSCommand, return: [], log id: 2e79e89 >2013-12-05 05:03:20,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2a8bc1b8] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 5fbc5516 >2013-12-05 05:03:20,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2a8bc1b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 5fbc5516 >2013-12-05 05:03:20,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2a8bc1b8] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 330e4b88 >2013-12-05 05:03:21,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2a8bc1b8] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67825bb2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@369450ff}, log id: 330e4b88 >2013-12-05 05:03:26,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3863aa2c >2013-12-05 05:03:26,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3863aa2c >2013-12-05 05:03:26,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 744e393f >2013-12-05 05:03:26,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d9bed0f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6677a09}, log id: 744e393f >2013-12-05 05:03:31,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1507a7ed >2013-12-05 05:03:32,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1507a7ed >2013-12-05 05:03:32,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70c4c738 >2013-12-05 05:03:32,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3edaf9ab, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d1edb5b}, log id: 70c4c738 >2013-12-05 05:03:37,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 9acb1ef >2013-12-05 05:03:38,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 9acb1ef >2013-12-05 05:03:38,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: e8862e4 >2013-12-05 05:03:38,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ee8041c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d48f971c}, log id: e8862e4 >2013-12-05 05:03:43,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: d468a86 >2013-12-05 05:03:44,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: d468a86 >2013-12-05 05:03:44,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 19af1fb3 >2013-12-05 05:03:44,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4535c0b6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60671d34}, log id: 19af1fb3 >2013-12-05 05:03:49,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 48b0848e >2013-12-05 05:03:49,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 48b0848e >2013-12-05 05:03:49,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ba634dd >2013-12-05 05:03:50,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@734e9c1c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45ceccbb}, log id: ba634dd >2013-12-05 05:03:55,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3a593714 >2013-12-05 05:03:55,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3a593714 >2013-12-05 05:03:55,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f7fd175 >2013-12-05 05:03:55,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ab33587, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59022827}, log id: 4f7fd175 >2013-12-05 05:04:00,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3249742e >2013-12-05 05:04:01,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3249742e >2013-12-05 05:04:01,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 67ce2ced >2013-12-05 05:04:01,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfeb9657, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a06c2546}, log id: 67ce2ced >2013-12-05 05:04:06,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 66da6240 >2013-12-05 05:04:07,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 66da6240 >2013-12-05 05:04:07,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1568355a >2013-12-05 05:04:07,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ef83758, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49125437}, log id: 1568355a >2013-12-05 05:04:12,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2b25a38c >2013-12-05 05:04:13,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2b25a38c >2013-12-05 05:04:13,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3f8a5059 >2013-12-05 05:04:13,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75668bf7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de20bdf7}, log id: 3f8a5059 >2013-12-05 05:04:18,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70f1b19f >2013-12-05 05:04:18,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 70f1b19f >2013-12-05 05:04:18,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: b3471b >2013-12-05 05:04:19,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12375704, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aef13842}, log id: b3471b >2013-12-05 05:04:19,598 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-05 05:04:19,599 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:04:19,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e757a6 >2013-12-05 05:04:19,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7e757a6 >2013-12-05 05:04:24,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: db4fc95 >2013-12-05 05:04:24,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: db4fc95 >2013-12-05 05:04:24,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 68581d56 >2013-12-05 05:04:24,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd759b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@519405fa}, log id: 68581d56 >2013-12-05 05:04:29,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3d9fa00d >2013-12-05 05:04:30,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3d9fa00d >2013-12-05 05:04:30,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14b588a5 >2013-12-05 05:04:30,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8544b1ed, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e0e680e}, log id: 14b588a5 >2013-12-05 05:04:35,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 23a18673 >2013-12-05 05:04:36,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 23a18673 >2013-12-05 05:04:36,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 49949745 >2013-12-05 05:04:36,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb8b7cc4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4280e025}, log id: 49949745 >2013-12-05 05:04:41,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3812b4a9 >2013-12-05 05:04:42,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3812b4a9 >2013-12-05 05:04:42,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 253bf4a8 >2013-12-05 05:04:42,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3b459ef, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9f337cc}, log id: 253bf4a8 >2013-12-05 05:04:47,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38ee5b4a >2013-12-05 05:04:47,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 38ee5b4a >2013-12-05 05:04:47,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7f53a559 >2013-12-05 05:04:48,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89be75fd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb7cc81b}, log id: 7f53a559 >2013-12-05 05:04:53,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 33d4701b >2013-12-05 05:04:53,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 33d4701b >2013-12-05 05:04:53,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 286774ae >2013-12-05 05:04:53,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84f4fb15, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2defccfe}, log id: 286774ae >2013-12-05 05:04:58,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 22791160 >2013-12-05 05:04:59,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 22791160 >2013-12-05 05:04:59,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 572e14dd >2013-12-05 05:04:59,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cd80865, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9384dc9}, log id: 572e14dd >2013-12-05 05:05:04,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 68dbccb >2013-12-05 05:05:05,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 68dbccb >2013-12-05 05:05:05,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29232c6e >2013-12-05 05:05:05,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ed38586, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef577823}, log id: 29232c6e >2013-12-05 05:05:10,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1d828f0a >2013-12-05 05:05:11,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d828f0a >2013-12-05 05:05:11,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7494787c >2013-12-05 05:05:11,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b01c64f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b64a8716}, log id: 7494787c >2013-12-05 05:05:16,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 63adb42c >2013-12-05 05:05:16,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 63adb42c >2013-12-05 05:05:16,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 76eb27c1 >2013-12-05 05:05:17,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@964931e9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5306a6f}, log id: 76eb27c1 >2013-12-05 05:05:19,897 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2013-12-05 05:05:19,898 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:05:19,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4f305b04 >2013-12-05 05:05:20,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4f305b04 >2013-12-05 05:05:22,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2fd1e19e >2013-12-05 05:05:22,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2fd1e19e >2013-12-05 05:05:22,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79890bb4 >2013-12-05 05:05:22,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@501f2e84, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f2781e}, log id: 79890bb4 >2013-12-05 05:05:27,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 32207a7d >2013-12-05 05:05:28,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 32207a7d >2013-12-05 05:05:28,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7257cdac >2013-12-05 05:05:28,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5c84440, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dad9c3d}, log id: 7257cdac >2013-12-05 05:05:33,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67efbdf4 >2013-12-05 05:05:34,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 67efbdf4 >2013-12-05 05:05:34,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d2f62b6 >2013-12-05 05:05:34,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4da193e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d41190f}, log id: 1d2f62b6 >2013-12-05 05:05:39,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2ffca69f >2013-12-05 05:05:40,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ffca69f >2013-12-05 05:05:40,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3a9c8dac >2013-12-05 05:05:40,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@247fd039, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e375e962}, log id: 3a9c8dac >2013-12-05 05:05:45,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 12ee743c >2013-12-05 05:05:45,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 12ee743c >2013-12-05 05:05:45,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4d2e4b8e >2013-12-05 05:05:46,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@352b48b3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9a34073}, log id: 4d2e4b8e >2013-12-05 05:05:51,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 479f6271 >2013-12-05 05:05:51,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 479f6271 >2013-12-05 05:05:51,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7610fd7d >2013-12-05 05:05:51,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0fa9501, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff33acdd}, log id: 7610fd7d >2013-12-05 05:05:56,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 111172d0 >2013-12-05 05:05:57,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 111172d0 >2013-12-05 05:05:57,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 617e1b72 >2013-12-05 05:05:57,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f57a7aa9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc0171c}, log id: 617e1b72 >2013-12-05 05:06:02,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 70c1a0e2 >2013-12-05 05:06:03,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 70c1a0e2 >2013-12-05 05:06:03,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 15f84db2 >2013-12-05 05:06:03,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d18e17b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e099e9ae}, log id: 15f84db2 >2013-12-05 05:06:08,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 78d36879 >2013-12-05 05:06:09,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 78d36879 >2013-12-05 05:06:09,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1f95802 >2013-12-05 05:06:09,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e133bfbc, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fff079eb}, log id: 1f95802 >2013-12-05 05:06:14,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 79bdba45 >2013-12-05 05:06:14,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 79bdba45 >2013-12-05 05:06:14,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 37c1f513 >2013-12-05 05:06:15,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14b6cde0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fff5a0a1}, log id: 37c1f513 >2013-12-05 05:06:20,200 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-05 05:06:20,200 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:06:20,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2309ff49 >2013-12-05 05:06:20,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 643e6b18 >2013-12-05 05:06:20,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2309ff49 >2013-12-05 05:06:20,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 643e6b18 >2013-12-05 05:06:20,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 41da3db1 >2013-12-05 05:06:21,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f16fcae4, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a4d4e3e}, log id: 41da3db1 >2013-12-05 05:06:26,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 473a0efc >2013-12-05 05:06:26,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 473a0efc >2013-12-05 05:06:26,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 53d8e17a >2013-12-05 05:06:26,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ded6f0b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@758e5090}, log id: 53d8e17a >2013-12-05 05:06:31,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1972f953 >2013-12-05 05:06:32,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1972f953 >2013-12-05 05:06:32,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3065f6a7 >2013-12-05 05:06:32,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@184a254f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38d54b5d}, log id: 3065f6a7 >2013-12-05 05:06:37,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 144ee4ad >2013-12-05 05:06:38,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 144ee4ad >2013-12-05 05:06:38,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 44a7e400 >2013-12-05 05:06:38,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e3eb14d, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@257fe966}, log id: 44a7e400 >2013-12-05 05:06:43,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: c9482ab >2013-12-05 05:06:44,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: c9482ab >2013-12-05 05:06:44,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6cd941eb >2013-12-05 05:06:44,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29dcb7e8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60b592d7}, log id: 6cd941eb >2013-12-05 05:06:49,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 42d1f7c2 >2013-12-05 05:06:49,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 42d1f7c2 >2013-12-05 05:06:49,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5fb01d53 >2013-12-05 05:06:50,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d13727b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1df1eb0}, log id: 5fb01d53 >2013-12-05 05:06:55,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 25c8337f >2013-12-05 05:06:55,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 25c8337f >2013-12-05 05:06:55,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: b4cef21 >2013-12-05 05:06:55,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b3772d9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4ad119f}, log id: b4cef21 >2013-12-05 05:07:00,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 78a34bfd >2013-12-05 05:07:01,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 78a34bfd >2013-12-05 05:07:01,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 23e0c986 >2013-12-05 05:07:01,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2afdeee9, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c89fba1}, log id: 23e0c986 >2013-12-05 05:07:06,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 57ca538a >2013-12-05 05:07:07,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 57ca538a >2013-12-05 05:07:07,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 415b67 >2013-12-05 05:07:07,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@396cf91e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40923037}, log id: 415b67 >2013-12-05 05:07:12,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6730a9bc >2013-12-05 05:07:12,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6730a9bc >2013-12-05 05:07:12,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 692b607c >2013-12-05 05:07:13,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7fea03, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af95189a}, log id: 692b607c >2013-12-05 05:07:18,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: b2f1809 >2013-12-05 05:07:18,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: b2f1809 >2013-12-05 05:07:18,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 939e1a0 >2013-12-05 05:07:19,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5970922, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5481688c}, log id: 939e1a0 >2013-12-05 05:07:20,474 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-05 05:07:20,474 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:07:20,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3fd9eb6a >2013-12-05 05:07:20,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3fd9eb6a >2013-12-05 05:07:24,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1491af6d >2013-12-05 05:07:24,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1491af6d >2013-12-05 05:07:24,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 41635e83 >2013-12-05 05:07:24,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d2c7b3c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@848fcfe7}, log id: 41635e83 >2013-12-05 05:07:29,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57961e62 >2013-12-05 05:07:30,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 57961e62 >2013-12-05 05:07:30,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18d92423 >2013-12-05 05:07:30,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31498130, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b45d0948}, log id: 18d92423 >2013-12-05 05:07:35,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4973c975 >2013-12-05 05:07:36,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4973c975 >2013-12-05 05:07:36,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 57fe610f >2013-12-05 05:07:36,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1bfd884, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d77b7a89}, log id: 57fe610f >2013-12-05 05:07:41,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 524ee5ce >2013-12-05 05:07:41,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 524ee5ce >2013-12-05 05:07:41,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 62d04053 >2013-12-05 05:07:42,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdb9723c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96b21b07}, log id: 62d04053 >2013-12-05 05:07:47,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 26eb5172 >2013-12-05 05:07:47,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 26eb5172 >2013-12-05 05:07:47,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7caaa6ee >2013-12-05 05:07:48,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8609dc7b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bb28572}, log id: 7caaa6ee >2013-12-05 05:07:53,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1cc41ff9 >2013-12-05 05:07:53,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1cc41ff9 >2013-12-05 05:07:53,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: c502c27 >2013-12-05 05:07:53,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffb6729, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42566b0}, log id: c502c27 >2013-12-05 05:07:58,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7fc5a1e9 >2013-12-05 05:07:59,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fc5a1e9 >2013-12-05 05:07:59,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 179f8bd5 >2013-12-05 05:07:59,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54895f3f, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c0619d4}, log id: 179f8bd5 >2013-12-05 05:08:04,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4bfbdfdb >2013-12-05 05:08:05,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4bfbdfdb >2013-12-05 05:08:05,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 30effcbe >2013-12-05 05:08:05,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e57c25da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a54aa395}, log id: 30effcbe >2013-12-05 05:08:10,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7f638a2d >2013-12-05 05:08:10,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f638a2d >2013-12-05 05:08:10,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 71fd2078 >2013-12-05 05:08:11,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1305d04, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cde6730}, log id: 71fd2078 >2013-12-05 05:08:16,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 334c3850 >2013-12-05 05:08:16,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 334c3850 >2013-12-05 05:08:16,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 12d5940e >2013-12-05 05:08:17,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@654afd05, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0d6dad9}, log id: 12d5940e >2013-12-05 05:08:18,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 18be673e >2013-12-05 05:08:18,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@748a82b1, log id: 18be673e >2013-12-05 05:08:18,942 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-3) [447df991] Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:08:18,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 318a6e3d >2013-12-05 05:08:19,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@760d0e56, log id: 318a6e3d >2013-12-05 05:08:20,767 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-05 05:08:20,768 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:08:20,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 34de0541 >2013-12-05 05:08:21,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: 34de0541 >2013-12-05 05:08:22,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 14613b40 >2013-12-05 05:08:22,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 14613b40 >2013-12-05 05:08:22,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 47bdc049 >2013-12-05 05:08:23,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce3d7f01, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@352b85a8}, log id: 47bdc049 >2013-12-05 05:08:28,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6175c216 >2013-12-05 05:08:28,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6175c216 >2013-12-05 05:08:28,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 614a659b >2013-12-05 05:08:28,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b2aefa0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5760339}, log id: 614a659b >2013-12-05 05:08:33,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1df22b4b >2013-12-05 05:08:34,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 1df22b4b >2013-12-05 05:08:34,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 39b4d8a2 >2013-12-05 05:08:34,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f575ddb0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a541d12}, log id: 39b4d8a2 >2013-12-05 05:08:39,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4d5b6d87 >2013-12-05 05:08:40,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4d5b6d87 >2013-12-05 05:08:40,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4bf8429b >2013-12-05 05:08:40,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d767ffe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2be7e37d}, log id: 4bf8429b >2013-12-05 05:08:45,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 665ccf23 >2013-12-05 05:08:46,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 665ccf23 >2013-12-05 05:08:46,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 127da8fa >2013-12-05 05:08:46,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dde722a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e796925}, log id: 127da8fa >2013-12-05 05:08:51,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 14db36b5 >2013-12-05 05:08:51,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 14db36b5 >2013-12-05 05:08:51,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1a8a3ded >2013-12-05 05:08:52,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d25e2aa, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d076be53}, log id: 1a8a3ded >2013-12-05 05:08:57,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 651cdab9 >2013-12-05 05:08:57,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 651cdab9 >2013-12-05 05:08:57,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4b29ead >2013-12-05 05:08:57,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa5bd284, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dd97ce5}, log id: 4b29ead >2013-12-05 05:09:02,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [18c3ff07] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: cc950c8 >2013-12-05 05:09:03,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [18c3ff07] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: cc950c8 >2013-12-05 05:09:03,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [18c3ff07] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5b1e3fb1 >2013-12-05 05:09:03,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [18c3ff07] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42517e00, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f38a83a}, log id: 5b1e3fb1 >2013-12-05 05:09:08,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5d748de3 >2013-12-05 05:09:09,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d748de3 >2013-12-05 05:09:09,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 22f51e2b >2013-12-05 05:09:09,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca885152, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@689f6378}, log id: 22f51e2b >2013-12-05 05:09:14,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 35102ee2 >2013-12-05 05:09:15,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 35102ee2 >2013-12-05 05:09:15,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7ea51a0d >2013-12-05 05:09:15,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f591fd8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e81e173}, log id: 7ea51a0d >2013-12-05 05:09:20,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4a262761 >2013-12-05 05:09:20,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a262761 >2013-12-05 05:09:20,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4afbdad3 >2013-12-05 05:09:21,072 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-05 05:09:21,072 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:09:21,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4625536c >2013-12-05 05:09:21,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@771741df, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bdfe502}, log id: 4afbdad3 >2013-12-05 05:09:21,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4625536c >2013-12-05 05:09:26,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4888b343 >2013-12-05 05:09:26,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4888b343 >2013-12-05 05:09:26,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7a16bbb4 >2013-12-05 05:09:26,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e60bd572, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c43ce7d4}, log id: 7a16bbb4 >2013-12-05 05:09:31,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 650d7108 >2013-12-05 05:09:32,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 650d7108 >2013-12-05 05:09:32,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 32058f7a >2013-12-05 05:09:32,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9966c2fe, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e777852}, log id: 32058f7a >2013-12-05 05:09:37,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 32d46f63 >2013-12-05 05:09:38,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 32d46f63 >2013-12-05 05:09:38,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 49d0b7a0 >2013-12-05 05:09:38,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d178537, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53c95c31}, log id: 49d0b7a0 >2013-12-05 05:09:43,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3f2e3717 >2013-12-05 05:09:44,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3f2e3717 >2013-12-05 05:09:44,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4297372d >2013-12-05 05:09:44,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6e2caf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dba0cc94}, log id: 4297372d >2013-12-05 05:09:49,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5b559d77 >2013-12-05 05:09:49,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b559d77 >2013-12-05 05:09:49,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 496e2e22 >2013-12-05 05:09:50,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfb443d2, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@759a248d}, log id: 496e2e22 >2013-12-05 05:09:55,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5469e762 >2013-12-05 05:09:55,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5469e762 >2013-12-05 05:09:55,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4645ff5c >2013-12-05 05:09:56,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f53b17c3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e204378}, log id: 4645ff5c >2013-12-05 05:10:01,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 53647532 >2013-12-05 05:10:01,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 53647532 >2013-12-05 05:10:01,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5140871d >2013-12-05 05:10:01,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6751f37, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7207bf99}, log id: 5140871d >2013-12-05 05:10:06,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2dd0d9a >2013-12-05 05:10:07,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2dd0d9a >2013-12-05 05:10:07,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7d112818 >2013-12-05 05:10:07,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@312f57bd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c54baaf}, log id: 7d112818 >2013-12-05 05:10:12,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 51eb9903 >2013-12-05 05:10:13,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 51eb9903 >2013-12-05 05:10:13,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5202bda0 >2013-12-05 05:10:13,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3507408a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad9b428c}, log id: 5202bda0 >2013-12-05 05:10:18,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 38f6b78b >2013-12-05 05:10:19,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 38f6b78b >2013-12-05 05:10:19,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 36339a6a >2013-12-05 05:10:19,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32f6254b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a7dc237}, log id: 36339a6a >2013-12-05 05:10:21,366 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-05 05:10:21,366 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:10:21,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: ec4a4cb >2013-12-05 05:10:21,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: ec4a4cb >2013-12-05 05:10:24,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 70596f2b >2013-12-05 05:10:24,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 70596f2b >2013-12-05 05:10:24,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6ec29134 >2013-12-05 05:10:25,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10345810, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5fde4dd}, log id: 6ec29134 >2013-12-05 05:10:30,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 24d4cee5 >2013-12-05 05:10:30,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 24d4cee5 >2013-12-05 05:10:30,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 17639457 >2013-12-05 05:10:30,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94104857, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5432cd8}, log id: 17639457 >2013-12-05 05:10:35,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b28e2f6 >2013-12-05 05:10:36,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1b28e2f6 >2013-12-05 05:10:36,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 6610be >2013-12-05 05:10:36,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bded37bf, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7be66bd}, log id: 6610be >2013-12-05 05:10:41,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5f16df3a >2013-12-05 05:10:42,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5f16df3a >2013-12-05 05:10:42,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 51cdd21 >2013-12-05 05:10:42,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7032542, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@866cbcbf}, log id: 51cdd21 >2013-12-05 05:10:47,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3276726d >2013-12-05 05:10:48,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 3276726d >2013-12-05 05:10:48,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 34730e9e >2013-12-05 05:10:48,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f4b2b98, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9956d05c}, log id: 34730e9e >2013-12-05 05:10:53,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 52c55cc1 >2013-12-05 05:10:53,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 52c55cc1 >2013-12-05 05:10:53,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6de56ae0 >2013-12-05 05:10:54,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1063247, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac46976b}, log id: 6de56ae0 >2013-12-05 05:10:59,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 342d59de >2013-12-05 05:10:59,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 342d59de >2013-12-05 05:10:59,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 50933cbd >2013-12-05 05:11:00,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98a3af46, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17b3bc72}, log id: 50933cbd >2013-12-05 05:11:05,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3d06a517 >2013-12-05 05:11:05,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d06a517 >2013-12-05 05:11:05,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 330e0bca >2013-12-05 05:11:05,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9629f41b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f131e6e1}, log id: 330e0bca >2013-12-05 05:11:10,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6bf135fa >2013-12-05 05:11:11,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bf135fa >2013-12-05 05:11:11,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 22ddff85 >2013-12-05 05:11:11,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f45ca3a6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20392e22}, log id: 22ddff85 >2013-12-05 05:11:16,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4f210b51 >2013-12-05 05:11:17,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 4f210b51 >2013-12-05 05:11:17,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 785fb37b >2013-12-05 05:11:17,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afb016d6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10673cb8}, log id: 785fb37b >2013-12-05 05:11:21,669 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) No up server in cluster >2013-12-05 05:11:21,669 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:11:21,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2348f117 >2013-12-05 05:11:21,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2348f117 >2013-12-05 05:11:22,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7ec30c1e >2013-12-05 05:11:22,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7ec30c1e >2013-12-05 05:11:22,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 177c44ce >2013-12-05 05:11:23,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26cba05b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9a2c6eb}, log id: 177c44ce >2013-12-05 05:11:28,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b0a4f40 >2013-12-05 05:11:28,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1b0a4f40 >2013-12-05 05:11:28,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 149aed30 >2013-12-05 05:11:29,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df31cdfd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b172ed5}, log id: 149aed30 >2013-12-05 05:11:34,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 60331593 >2013-12-05 05:11:34,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 60331593 >2013-12-05 05:11:34,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3501793a >2013-12-05 05:11:34,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@520a8a21, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@272969a4}, log id: 3501793a >2013-12-05 05:11:39,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 623ce10a >2013-12-05 05:11:40,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 623ce10a >2013-12-05 05:11:40,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5a46ed7e >2013-12-05 05:11:40,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a292fda, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42803d12}, log id: 5a46ed7e >2013-12-05 05:11:45,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 14921ed7 >2013-12-05 05:11:46,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 14921ed7 >2013-12-05 05:11:46,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 59b22b83 >2013-12-05 05:11:46,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@340bbb77, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ccca410}, log id: 59b22b83 >2013-12-05 05:11:51,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 67c4455d >2013-12-05 05:11:52,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 67c4455d >2013-12-05 05:11:52,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 271b4a5b >2013-12-05 05:11:52,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@433cc188, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad665a9}, log id: 271b4a5b >2013-12-05 05:11:57,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 75f695a9 >2013-12-05 05:11:57,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 75f695a9 >2013-12-05 05:11:57,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 66b5a1f8 >2013-12-05 05:11:58,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b17e13ea, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78813525}, log id: 66b5a1f8 >2013-12-05 05:12:03,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1dc14e1d >2013-12-05 05:12:03,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1dc14e1d >2013-12-05 05:12:03,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4dd61048 >2013-12-05 05:12:04,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1dda090, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d5a88c0}, log id: 4dd61048 >2013-12-05 05:12:09,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 196a59da >2013-12-05 05:12:09,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 196a59da >2013-12-05 05:12:09,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 730007f5 >2013-12-05 05:12:09,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8c47298, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bdcd759}, log id: 730007f5 >2013-12-05 05:12:14,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 608442d8 >2013-12-05 05:12:15,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 608442d8 >2013-12-05 05:12:15,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2b4b0891 >2013-12-05 05:12:15,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1db7760a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26b87dfa}, log id: 2b4b0891 >2013-12-05 05:12:20,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 497f12a6 >2013-12-05 05:12:21,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 497f12a6 >2013-12-05 05:12:21,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 371c2f0e >2013-12-05 05:12:21,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d2e0678, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33acf4b}, log id: 371c2f0e >2013-12-05 05:12:21,959 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-05 05:12:21,959 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:12:21,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3a071c72 >2013-12-05 05:12:22,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3a071c72 >2013-12-05 05:12:26,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 6cfd6490 >2013-12-05 05:12:27,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cfd6490 >2013-12-05 05:12:27,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 1bed3378 >2013-12-05 05:12:27,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [447df991] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4d7a1e0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbd04c6e}, log id: 1bed3378 >2013-12-05 05:12:32,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 21f4dbdb >2013-12-05 05:12:32,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 21f4dbdb >2013-12-05 05:12:32,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 7780a2a3 >2013-12-05 05:12:33,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3cdfc8e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bfcc7dd}, log id: 7780a2a3 >2013-12-05 05:12:38,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 38e10609 >2013-12-05 05:12:38,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 38e10609 >2013-12-05 05:12:38,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 412d06b1 >2013-12-05 05:12:38,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28fb301e, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2723c76}, log id: 412d06b1 >2013-12-05 05:12:44,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 42211f08 >2013-12-05 05:12:44,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 42211f08 >2013-12-05 05:12:44,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 66ec893d >2013-12-05 05:12:44,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd4f18fb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@475eec8d}, log id: 66ec893d >2013-12-05 05:12:49,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 305fc553 >2013-12-05 05:12:50,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 305fc553 >2013-12-05 05:12:50,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 540b3e94 >2013-12-05 05:12:50,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fcef903, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@144311a8}, log id: 540b3e94 >2013-12-05 05:12:55,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 529bb8e8 >2013-12-05 05:12:56,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 529bb8e8 >2013-12-05 05:12:56,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 53741434 >2013-12-05 05:12:56,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f04e79c7, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@560f7cc3}, log id: 53741434 >2013-12-05 05:13:01,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1a9dcecf >2013-12-05 05:13:01,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1a9dcecf >2013-12-05 05:13:01,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 45954b9c >2013-12-05 05:13:02,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bc173a6, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec78177a}, log id: 45954b9c >2013-12-05 05:13:07,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2f50dff5 >2013-12-05 05:13:07,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f50dff5 >2013-12-05 05:13:07,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: f9e7da3 >2013-12-05 05:13:08,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@974cf767, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f12ddf86}, log id: f9e7da3 >2013-12-05 05:13:13,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1d2eebe >2013-12-05 05:13:13,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1d2eebe >2013-12-05 05:13:13,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7d517adf >2013-12-05 05:13:13,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65b092b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f7c9d6e}, log id: 7d517adf >2013-12-05 05:13:18,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7e11cc18 >2013-12-05 05:13:19,241 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-20) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-05 05:13:19,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7e11cc18 >2013-12-05 05:13:19,410 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-20) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-05 05:13:19,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39119231 >2013-12-05 05:13:19,617 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-20) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-05 05:13:19,619 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-20) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 70e19cf2-4ea8-40ed-b899-62a82c916654 value: GLUSTER >, sharedLocks= ] >2013-12-05 05:13:19,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cd7ad0, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0abf727}, log id: 39119231 >2013-12-05 05:13:19,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6c288cef >2013-12-05 05:13:19,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@21d8aeb1, log id: 6c288cef >2013-12-05 05:13:19,980 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-20) Error while refreshing brick statuses for volume dis_rep_vol of cluster test: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:840) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:791) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:766) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:13:19,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 18b4f7d3 >2013-12-05 05:13:20,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@66d4b6c5, log id: 18b4f7d3 >2013-12-05 05:13:22,258 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) No up server in cluster >2013-12-05 05:13:22,258 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:13:22,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 64c5830 >2013-12-05 05:13:22,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterTasksListVDSCommand, return: [], log id: 64c5830 >2013-12-05 05:13:24,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 2379b45d >2013-12-05 05:13:25,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 2379b45d >2013-12-05 05:13:25,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 54c49570 >2013-12-05 05:13:25,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e72e6c86, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc0f3a95}, log id: 54c49570 >2013-12-05 05:13:30,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 50150231 >2013-12-05 05:13:31,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 50150231 >2013-12-05 05:13:31,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 77f485f7 >2013-12-05 05:13:31,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7601884, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55fa468a}, log id: 77f485f7 >2013-12-05 05:13:36,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 36c5f0c9 >2013-12-05 05:13:36,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 36c5f0c9 >2013-12-05 05:13:36,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 40996373 >2013-12-05 05:13:37,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a658a31, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc08240}, log id: 40996373 >2013-12-05 05:13:42,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 67004fb5 >2013-12-05 05:13:42,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 67004fb5 >2013-12-05 05:13:42,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: bb64ae7 >2013-12-05 05:13:42,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da07afdd, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64a88d9}, log id: bb64ae7 >2013-12-05 05:13:47,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5f8901dd >2013-12-05 05:13:48,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5f8901dd >2013-12-05 05:13:48,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 41e86cfe >2013-12-05 05:13:48,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c202f588, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdd2d1e0}, log id: 41e86cfe >2013-12-05 05:13:53,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1d3a0e3e >2013-12-05 05:13:54,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1d3a0e3e >2013-12-05 05:13:54,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 652651ab >2013-12-05 05:13:54,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4a59085, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf995317}, log id: 652651ab >2013-12-05 05:13:59,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 3e864d9d >2013-12-05 05:13:59,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3e864d9d >2013-12-05 05:13:59,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 16c28d21 >2013-12-05 05:14:00,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8c7f315, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3eab0202}, log id: 16c28d21 >2013-12-05 05:14:05,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 29671c4c >2013-12-05 05:14:05,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 29671c4c >2013-12-05 05:14:05,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 457786e8 >2013-12-05 05:14:06,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1ae7609, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d051dc04}, log id: 457786e8 >2013-12-05 05:14:11,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 6e444f79 >2013-12-05 05:14:11,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 6e444f79 >2013-12-05 05:14:11,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 4ad74c8c >2013-12-05 05:14:11,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dee36360, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa2aca68}, log id: 4ad74c8c >2013-12-05 05:14:16,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7aaaefc2 >2013-12-05 05:14:17,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 7aaaefc2 >2013-12-05 05:14:17,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1d4d0a05 >2013-12-05 05:14:17,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cb9d001, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52cea542}, log id: 1d4d0a05 >2013-12-05 05:14:22,578 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-05 05:14:22,578 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_45] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:14:22,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 278a1d28 >2013-12-05 05:14:22,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 2d9a6188 >2013-12-05 05:14:22,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 278a1d28 >2013-12-05 05:14:23,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d9a6188 >2013-12-05 05:14:23,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 58f4201c >2013-12-05 05:14:23,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@768607bb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@905854ec}, log id: 58f4201c >2013-12-05 05:14:28,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 29d07d22 >2013-12-05 05:14:28,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 29d07d22 >2013-12-05 05:14:28,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 7ea976ee >2013-12-05 05:14:29,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acde2618, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1b23ee7}, log id: 7ea976ee >2013-12-05 05:14:34,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 114283ee >2013-12-05 05:14:34,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 114283ee >2013-12-05 05:14:34,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1b5912d6 >2013-12-05 05:14:35,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da27db22, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fd5cd0c}, log id: 1b5912d6 >2013-12-05 05:14:40,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 682f1cbb >2013-12-05 05:14:40,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 682f1cbb >2013-12-05 05:14:40,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2e2bd659 >2013-12-05 05:14:40,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98bf6d75, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7295f4af}, log id: 2e2bd659 >2013-12-05 05:14:45,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 368b36b8 >2013-12-05 05:14:46,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 368b36b8 >2013-12-05 05:14:46,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 41f7e4d3 >2013-12-05 05:14:46,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35688a84, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dcb5e5c}, log id: 41f7e4d3 >2013-12-05 05:14:51,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 261c0704 >2013-12-05 05:14:52,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 261c0704 >2013-12-05 05:14:52,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 55ab9320 >2013-12-05 05:14:52,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70ff4e0c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@560c3a0}, log id: 55ab9320 >2013-12-05 05:14:57,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2a8bc1b8] START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70c35e06 >2013-12-05 05:14:57,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2a8bc1b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 70c35e06 >2013-12-05 05:14:57,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2a8bc1b8] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 57eb6a78 >2013-12-05 05:14:58,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) [2a8bc1b8] FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57540930, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95e5eab3}, log id: 57eb6a78 >2013-12-05 05:15:03,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 39a8e153 >2013-12-05 05:15:03,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 39a8e153 >2013-12-05 05:15:03,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 122c8fb7 >2013-12-05 05:15:04,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@165878c5, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@caea730b}, log id: 122c8fb7 >2013-12-05 05:15:09,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1096408a >2013-12-05 05:15:09,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1096408a >2013-12-05 05:15:09,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 7e85eef2 >2013-12-05 05:15:09,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@759caf54, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@317b4cb}, log id: 7e85eef2 >2013-12-05 05:15:14,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7e2c4e62 >2013-12-05 05:15:15,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 7e2c4e62 >2013-12-05 05:15:15,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 307045a8 >2013-12-05 05:15:15,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e649b9cb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc555901}, log id: 307045a8 >2013-12-05 05:15:20,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1104d45f >2013-12-05 05:15:21,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1104d45f >2013-12-05 05:15:21,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 3d544aac >2013-12-05 05:15:21,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48e53254, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7ca7146}, log id: 3d544aac >2013-12-05 05:15:22,855 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-05 05:15:22,855 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:15:22,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 14d86bd >2013-12-05 05:15:23,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 14d86bd >2013-12-05 05:15:26,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5fe4fa2 >2013-12-05 05:15:26,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5fe4fa2 >2013-12-05 05:15:26,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 70c2bdd1 >2013-12-05 05:15:27,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d0cc411, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4d86a24}, log id: 70c2bdd1 >2013-12-05 05:15:32,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 2498c059 >2013-12-05 05:15:32,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 2498c059 >2013-12-05 05:15:32,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 7a4c7a36 >2013-12-05 05:15:33,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6915308c, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c788df6}, log id: 7a4c7a36 >2013-12-05 05:15:38,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 3bddec5d >2013-12-05 05:15:38,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 3bddec5d >2013-12-05 05:15:38,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 5aa6120 >2013-12-05 05:15:38,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6de58907, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@634b871f}, log id: 5aa6120 >2013-12-05 05:15:43,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 4f667aa7 >2013-12-05 05:15:44,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f667aa7 >2013-12-05 05:15:44,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 119529e9 >2013-12-05 05:15:44,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6da194da, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68b56c0a}, log id: 119529e9 >2013-12-05 05:15:49,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 253c6f49 >2013-12-05 05:15:50,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 253c6f49 >2013-12-05 05:15:50,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 75ea59f4 >2013-12-05 05:15:50,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5604edae, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99c75bc}, log id: 75ea59f4 >2013-12-05 05:15:55,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 6a5f0d74 >2013-12-05 05:15:56,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 6a5f0d74 >2013-12-05 05:15:56,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 467cf262 >2013-12-05 05:15:56,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a413d0b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d34ab2a6}, log id: 467cf262 >2013-12-05 05:16:01,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1ec37acf >2013-12-05 05:16:01,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 1ec37acf >2013-12-05 05:16:01,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 1ca82d0d >2013-12-05 05:16:02,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca50f99b, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bd32210}, log id: 1ca82d0d >2013-12-05 05:16:07,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4e09f0b9 >2013-12-05 05:16:07,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 4e09f0b9 >2013-12-05 05:16:07,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 1ff4d3ef >2013-12-05 05:16:07,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83b4a7e3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9b8afd1}, log id: 1ff4d3ef >2013-12-05 05:16:12,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 5b4394fc >2013-12-05 05:16:13,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 5b4394fc >2013-12-05 05:16:13,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2cdef2c6 >2013-12-05 05:16:13,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcef51b8, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8eb5ded}, log id: 2cdef2c6 >2013-12-05 05:16:18,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 58a602f6 >2013-12-05 05:16:19,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 58a602f6 >2013-12-05 05:16:19,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 2b748d80 >2013-12-05 05:16:19,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@282c1fa3, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@537cc8d6}, log id: 2b748d80 >2013-12-05 05:16:23,158 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-05 05:16:23,159 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-05 05:16:23,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = 29276a10-e580-47a3-8d4a-5be883880e91), log id: 4b04c320 >2013-12-05 05:16:23,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4b04c320 >2013-12-05 05:16:24,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 59abb852 >2013-12-05 05:16:25,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 59abb852 >2013-12-05 05:16:25,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 71166249 >2013-12-05 05:16:25,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a703289a, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94c52e10}, log id: 71166249 >2013-12-05 05:16:30,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 5714bfb6 >2013-12-05 05:16:30,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 5714bfb6 >2013-12-05 05:16:30,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 70cfbea9 >2013-12-05 05:16:31,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f56fcc74, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d2607b6}, log id: 70cfbea9 >2013-12-05 05:16:36,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 62f8604b >2013-12-05 05:16:36,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.155:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED, 10.70.37.147:CONNECTED], log id: 62f8604b >2013-12-05 05:16:36,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host3, HostId = fce21e1b-8581-4c72-bf3c-7db552d78d13), log id: 4597a35f >2013-12-05 05:16:36,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d85f2323, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a80560a}, log id: 4597a35f >2013-12-05 05:16:41,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 1e942106 >2013-12-05 05:16:42,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.147:CONNECTED], log id: 1e942106 >2013-12-05 05:16:42,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 4c17e50e-8225-48c6-bcb3-bfba4ec37037), log id: 45429ffd >2013-12-05 05:16:42,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7d6a957, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21d32126}, log id: 45429ffd >2013-12-05 05:16:47,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 28507e67 >2013-12-05 05:16:48,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.147:CONNECTED, 10.70.37.118:CONNECTED, 10.70.37.155:CONNECTED, 10.70.37.74:CONNECTED], log id: 28507e67 >2013-12-05 05:16:48,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host4, HostId = 9ce61f4d-b2e2-4444-ba60-8262a9cd0e61), log id: 3c50f40e >2013-12-05 05:16:48,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {dbfbcab7-6ec2-4bed-89de-aef7e409e97c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d9db6cb, be2c16f2-a173-4bac-a979-47cf211a97e3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29c906dd}, log id: 3c50f40e
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1027743
:
821018
|
832039
| 833025 |
838765